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Preface 



■ Interim Report II was submitted at the end of the first year 
.-of Project Developmental Continuity (PDC) to present our recom- 
mendationp for measuring program impact. The present- volume - 
represents. an updating .of the June 1975 draft report. After tha ' 
draft report was reviewed by OCD and various consultants, several 
our recommendations were modified; 'these modifications have '^Deen 
. incorpprated into the present .volume. The intent 'of this report 
as to provide "the basic ratioijale of the measures to bfe used in 
PDC; It IS not- an exhaustive ](eview of all possible measu|res>. 

Most of the -15 FCC ^ograms were funded in, the summer of 
1974 fpr a year of planning during which preparations would be 
made for beginning 'operations in September 1975 in all compon- 
ents—education, trainindf, -parent involvemeat, administration, 
.support services^ services for handicapped children and pr<3grams 
for bilingual/bicultural .children, ' As with all Head Start ; 
.demonstration programs, Developmental Continuity is a jnultifaceted 
program that requires a complex evaluation process . .In f>rder to 
provide answers to many questions regarding programs' and policy, 
the Office of Child Development designed a broad-based study 
that focuses both on the process of establishing and operating 
programs and on the impact that the progra,ms are expected to ' 
have on .children, families, M^ad Start and school teaching staff, 
administrators and on the institutions themselj^es. • 

DiMTing 1974-75, the evaluation focused on assessing €he 
planning process.- Two visits were made to each program, and a 
case study was prepared for each program tp describe and analyze 
the year'^ events. A ."national case study" provides a summary 
of plahni/ig activities from a national perspective and an analysis 
of trends acrpss sites. The 15 program case studies -and the 
national case- study^ constitute Part C of this report. ' , > . 

The assessment of program impact; of coutse,' can only'i>ccur 
after there has been an ••opportunity for children to experience 
continuity from Head Start to elementary school.' Since there 
are frequently problems during program start-up that are not 
typical of a fully operating pirogram, there will.be no assessment 
of impact during 1975-76 (Year II);' the first , cohort to be - 
tested, interviev(ed arid observed for impact assessment will ent«r 
in the. .fall of 1976 (Year III).r DuringvYear 11 the assessment 
procedures will be pilot tested. on a sample of Head Start children 
from PDC an^ cdmparison groups in- most of the" sites. Year I 
h^s been a year of preparation during whicTi there have been two 
major .concerns^: . locating suitable He^d, Star't- centers and ^ 
elementary schools in each site • to* serve ^ ^'comparisons'* for ': 
the PDC Head Start and school; and seleqtihg'^ measure? that would' • 
be appropriate for assessing the impact^'pf Project Developmental • 
Continuity. Information on the comparisxin groups, along with ~ 
baseline data and discussions of the analysis plan, constitutes" 
PartrA of this report. .. , • ' 
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INTRODpCTIpN- 



V. -'This volume presentts the recommendations for. measures to 
be used for 'assessihg the iTirpact of Project Developmental 
Con'tihuity (PDC) . In the introduction (Ctiapter I) the purpose ' 
of the impact ""^tudy is reviewed and the'basic considerations 
guiding the selection qf measures are- presented. Chapter II 
describes the"^ review process that led to* the final recommenda- ' 
tions, which are presented in Chq:pter ill with supporting 
rationale. The appendix contains one-page summaries of the 
characteristics of the measures recommended wi^th descriptions 
of the itpms, * administration procedures and .scoring criteria. 

^ * Purpose oi the Impact «-Study. ) 

The work statement fbf the ^Project 'Developmental Continuity 
evaluation (RFP-4-75-riEW-OS) specified- two primary objectives- 
fpr t-he impact study: / 

• ' To assfess the^ !^pact of P.reschool-School Linkages and 
> *^ Early Childhood Schpols on the development* Qf. social 

competence in children four to eight years of |kge; and^ 

• To assess the impact of the tvto program approaches 
(ECS, and PSL) on the -preschoold^ schools, giuid other 
community institutioas involved in -the program ► 

The ^impact of Developmental Continuiiiy must obviously be broadly 
Conceptualized, not iij terms of children * s "intelligence , " or 
even solely in terms ii>f the children — but in terms of all areas ; 
in which the program might be expected to have ah impact. For - 
convenience, the areas of aocpected impact can' be grouped into ^ 
four categories: 

The instituti'ons ,and their relationships 
PDC staff /<«teachers and administrators 

• Parents 

• * Chi Idren's social compelsence 

A variety of mea^ur^^ are required to complete an • assessment in 
each of these ^^areai . Th'e V^P^ct on the participating ^institu- 
Ltions and any changes in thea:r relationships will be assessed 



ppiraarily tlirough. structured and semi-structured interviews, 
with "key people connected wit.h: the, program, by asking- partici- * 
pants in key roles to fate factprs such*"as the influence of 
the participants, and through examination of records. Much 
of .this is being accomplished in the program case studies ' * 
(see Part C af this report) but • §ome additional measures, not 
yetvpart of 'the case study procedures, are reviewed hfere. 

The impact on PDC staff,, teachers^ and administrators and 
on parents will be assessed using ' interviews , questionnaires, 
anoC rating scales and ^by examining records 'such as minutes of ' > 
_,committe^ meetings.^ A wide - range^ of effects is expected for 
■tht^se pa'rticipants (participation* in decision-njaking , problem- 
solving,^ attitude" change, etc.),' and these are also diseased 
below; ^ ^ . , 

Thte impact of PDC on children's s.ocial competence is 
probably the most complex of the areas of expected impact and 
the ar^a that appears to receive the* greatest -^ttentidn in 
thiB report. This is due to the fact that social competence " 
is itself a multi faceted concept, that its cortceptualizatdon 
and Qperationalizat ion are subject to considerable Controversy, 
and .tl^at a ,wide selection of assessment procedu3?es is avail- 
able for review. The four dimensions of social' competence , 
considered Here (social-emotional, psychomotor, cognitive and 
language, and Jiealth >and nutrition) can betass^ssed by int^r- . 
views, rating scales, structured tests, cl^s^room observation 
and by examining program records in an atterppt to obtain as 
full a picture as possible of the developing "compe^en^'ce " of 
children who experience Developmental Continuity. ' . ' 

s 

Considerations in ^electing. Measures - t ' 

• Six general "guidelines** have beep followed in making'' 
decisions on J^he r^ieasures for this evaluation: In addition, 
five specific critexia have b^en applied in assessing the 
suitability of the measures. In th^is discussioi|^ a' distinction 
is made -between the "ba'sic" measurement ^battery — a set of 
measures that will he used in all PDC sites to assess objectives 
that are characteristic of J^DC as^a national program — and. site- 
. specific batteries relevant to the unique objqc^ives of indl^id- 
"^ual programs and suitable -.'ifor t^e cultural setting of , each site. 

/ ' . r : . ' 

♦ / » 
General Guideli-nes ^ , •* " , ' ^ It 

The*first gflideline is that no new mea*sures will be 
sdhedul^d for development as patt of the basic' battery, other, 
tha^ questionnaires anql interview protocols iS^cific to this 
atudy. It is -possible to distinguish studies which' are;, 
intended to develop tests ffom studies int^ded to produce 



f information fpf substantive d6<?rsi'cSD3^ (C:j;?©'nbach^ Gie'^er, N^nda/ | " « 
, Raj aratnam* ',19 72) . The two kinds of '%^ti"dres' mifet be designed . , • 
•differently foir* maximum^ Effectiveness and efficiency, and in 
•general yield^ l^sg than optimal' results 'when combined , into a 
single study. * This^would argue 'against selecting new instru- * * 
men^ts, of promising but' relatively, unjleveloped orteV whi(6h would 
»need major ihstrument development, as an integral ^part of the ( 
^evaluation. In addition, adequate test develo^me'nt is a pr*- — 
'hiyTtively expensive undertaking that'is beyond the available , 
^ resources of this evaluation. » , • , 

Unfortunately, as Chapter III^wilT indiQa.t§, n:o measure - 
that is already fully developed has been found thafmeets all 
.the specific -selection criteria listed below. .Further, many . ^ .[\ 
•evaluations (e.g.,**the national- Fol'low Through evaluation)' have J^, 
^ been criticized precisely because' their lise of existing .stan- 

dardized tests did noH,^ yield the kind of inrormatitwi use,ful ' ^ * . ' 

for policy decisions (Rivlin jL^d Timpane', 1975). There^fore) 

this .first guideline was mgdified as follows: subtests <pr- sets ^ 

• of items of develdped measures that best meet the criteria are ^ 
reconunended, and mbdifications of less 'well-developed measures 
ar^ being reconunen'ded ..^pr pilot testing during tear II. • 

Thys/' a second guicjeline, comes^ into play:* some' ins txtlm^nt 

• development can be anticipated- for each of t^he measures in the 
proposed battery.' Even thqugh ^giajor test developmenit. is^ not ' . • 
feasible,^ nearly all bf, the^,^asures considered for' inclusion ' ; ' 

, in the evaluation could^prof i,t from further developtnent qf a • 
relatively minor and straight forward .nat;ure . For example, ^ • 

' this' may include something as sihiple as . augmenting ^alteady ' ^ ' 
existingv^ormative data,' or as compTex as, item revision;^and 
factor rearrangement, absolutely necessary, s^y if ohe of * , • 

tlie projSpsed measures does not vJork out as expected based on 
analysis the Year II. fall data, it would sti^'l ' ^e .possible \ ' . 
to substitute an»"entirely new measure for the spring data " . 
collection of Year II*. It is hoped,- however , that the process % 

•will be one of continuous refinement-, rather than 'a. series of ' ' \ 
m4t]or changes. - , "f^ r ♦ • : 

Third, instruments must be evaluated for the basic battery > • \ ^ , 
in t;erms-^ ofv the overall objectives of Project Developmental » 
Continuity , «and must bd evaluated for the s^ite- specific Batteries 
in terms of site objectives and/ethnj.c and bilinaual/bf cultural ' ^ 
considerations. As part of thq measurement' selection process 
a qu^fetioQnaire was developed to obtain information from each ' 
' 'Site oh the program gCals or objectives considered^ espeqially 
ijnportant at that site. The respoTtses to this questionnaire • ^ 

and the decisions based on these responses are discussed in . / 

Chapter II. • m . ^ 
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Fotir^th, out of* consideration^ for participants in the. 
Developmental ' Contin'uity program, ' testing- time fgr any individ- 
ual^- shfould be limited to a reasbnable length* This S'uggfests 
that the different measures" used ^should be *the 'shortest possible 
.Vers iorfs' cfonsi^tent ' with ^sound measurement practice's. Moreo.ver,* 
^it is nbf feas:j.ble tp^' try pp zexo^ In^' oi^.a. particular- trait in 
this , evaluation, by- aciminj-stering ^s,ev^ral^ 'dif teren± ''but oy^r- ■ ^ 
lapping measures of . the trait in ordfer to utilise, for- example, , 
the mwltitrait-'mult^meth9d matrix .technique; '.Some measures- will 
be unobtrusive as.fai;, as^iie^ child* is ' concerned, ' and are thei?e- 
fore limited only by ^adequacy of records or amount of parent, ^ ^ 
teacher, oi^ a^Jministtator ' time they would take.{. , ;^ ^ 

t'ifth, the measurement battery should be efs simpl^^ and * 
parsKiionious-^ as possible to insure th^e accuracy ox data col lected 
under different field ^'conditions Many elaborate but otherwise 
good tests, must *be\ removed from consideration for this rg^ason. 

^ > ^ ^ ../ 

Sixth, single, items sliould be individu'ally int^rpretable ; . 
to the extent possible^ * regardless of any score pr factor 
structure they were inten^ded to be embedded ^in. One can never - 
be .sure that the reliability, yalid^ityi factor analysis outcomes, 
'test"" ceilings and floors, etc., will hold up for the population 
in this project. This suggests that the safety factor of being ^ 
able to interpret individual 'items as^ straightforward crit^jj4.a> 
might ultimately prove to-be a very, useful feature. The mOre 
simple and straightforward each proposed -t-est Ts at. the j.tem 
level , the greater the probability of get'ti;ig Some interpretable 
results -at the'end of the*project even under the-worst of ' . 
circums'tances . . ' " 

" • • * * ♦ * ' 

/ 

Specific Criteria * . \ ' ^ 

In reviewing candidates' fou^ inclusion in the proposed 
battery, five criteria were used " to assess the suitabili^ty pf 
measur6,s. In order of impprtance , * the itieasures mus-ts' 

. appear to measure stated national or local objectives; ^ 

• be appropriate , to the exeiminees' age, ability level, 
an/^bilingaal/bi»cultural status; 



be practical to administer; • 




haC^e been use4 successfully- i-n ' oth^r maj(S>r evaluations 
for t|ie basic battery) ; < ' ^ ; 



.'demonstrate good psychometric <:haracter istic&. 
Each of these criteria is discussed in turn below. 
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^ \, First, measures have been carefully examined* for. item - 

'content tj^pee if they appear Jto measure traits related to the 

goals of^^ne national* or ^ local project. The inspection of ° 

content 'has been used as the primaty e.vidence for validity 

.because 0^ a geneTal lack of quantitative validity data for 

*itit)st of the measures und^r consideration.^ 

***** " . " • J 

Second', ' m^a-sures which are relelvant to the goal areas, 
,have' been reviewed, in ternts of their 'suitability for the Project 
Developmental Continuity population . This means looking for 
the>«floor and ceiling levels to ensur'e ari adequate 4- to 8-year 
age* range, an. ex^amiaatfi^n of prdcedures and format for ea€e of 
undejTstahding' by the children, ^d an examination of suitab'ility 
of use with bilin'gual/bicultural children. ^ ' , 

Third, measures have been examined ^to^determine if they 
are practical -to ^administer.. The most iMjportAnt^ criterion here 
is;tjie overall time rec^uired by the test, ljut another very 
J.mpojgtept one is the general suitability/ for administration by • 
p-araf^f essional testers ^hixLed f rom- the cojtUnunity . This cri- 
terion has eliminated inany measurement techniques that requij» 
formal credenti'als ,' including the better known individual Iq' 
tests, projective 'tests, and depth interviews. Ea^e and clarity \ 
of scoring is ^another quai.ity sought in ^e . measures ' 

• Fourth, majqr past • uses of the measures have been taken 
into cons'ideration, witlj, preference given (for use, in the basic 
battery) to^ those used in other' national eyal/uations ._ The * 
Search for measures began with those used in- the national 
Planned' Variation Head Start evaluation conducted by Stanford ' 
Re^^arch Institute and with those used in the evaluation of' • 
Home Start cpnducte^ by High/Scope Educational Research Founda- 
tion. The 'Purpose of this criterion is to establish, insofar 
as possible, compaorability 'of ^data with tho'se two major evalua- g 
tions of preschool-aged children. Since' a great deal of ' 
comparability is not likely giveh the ye^rs of test development 
work si^ce the inception of |:hose projects-, the recommendations 
of^he Rand Corporation study (Raizeji and Bobrow, 1974aJ t\ave 
been considered and the measures currently being considered by 
.U^fe Stanford Research Institute for the National Day Caye CqsI^ .~ 
Bl^fects Stu^ly have been reviewed. • ^ 

.Fifth, measur^s"^ that seem satisfactory in reg'ard to the ^ J 
four Criteria mentioned above have been examined for reliability, 
excellence of norms, method, of construction, and suggestive 
results in other studies — -'in "short-, in all their important^ 
technical characteristics. It might seem peculiar to ex€unine 
su6h important features last, but if^^measures failed to ^meet 
•some of the- more pragmatic criteria above there was no need to 
^:onsider them further — good psychometric qualities notwithstanding 



,^ * ' PREPARATION FOR MEASUREMENT, SELECTION • . 

The proce'ss of Reviewing measures to be used for assess4ng. 
Project Developmental Continuity impact vatied ^according^ to- 
the gpal areas to be' assessed!' institu^tional change, effect on- 
teachers and other staff,- impact on parents, and impaction ^ 
children's social cpmpetence. The .pro6;ram case studies have, 
since 'the mid-yeaf 3ite visits, beep collecting information 
that is relevant to questions of institutional change and 
teacher and staff impact. • Since those issues are' dealt with- 
in the case study volumje (Part CT they will not receive as 
thorough a review het:e as the areas of impact on parents and 
children. In Chapter III, however, measures recommended in 
additionj^to the case study procedure will be described (see 
section on "Measuring^ Impact on Pareirt^^ and Teachers"). Thus, 
Chapter II focuses on"* attempts tJf) delineate the criticc^l dimen- 
sions of "social competence" in children and on the process- 
underlying the review an<i selection of measures for assessing 
impact ori children, parents ^ teachers and^staff. 




Derining Social Competence 

in January 1973 a panel of ^experts met at the Educational 
Testing Service to abtejnp^ to» define the meaning of social 
competency in ''young children {Anderst3n and Wessick, 1974), The^ 
deliberations of the panel culminated in a list of 29'compe- . . 
tencies (see Figure 1) . The nature of this list i-s important 
to the considerations for measuring spci^l competence in . * ^ 
Developanental Continuity — the list repr^s^ts child behaviors 
that span a broad rangd. The rationale' fof* this is in part 
attributable to the views of Edward Zigler> who in 1972 described^ 
Head Start as hoping: ^ ' , ^ 

... to .bring^bout greater social competence in disadvantaged! 
^ children.- By social competence is meant an_. individual ' s 

everyday' effectiveness -im 'dealing with his environment .. .his 
ability to master appropriate formal concepts, to perform 
well-ih school, to stay out pf trouble with tlhe law,, and to 
relate wqll to adults and-oth^r children (quoted by Anderson 
> ' and Messick, 1974,. p. 283). 



Areas of Social Competency Defined by Anderson and Messick (1974) 



5aliaattion 



Differentiated selfl-concept and consul i9attion of^dentity * 
Concept of self as |an initiating and opntrolling agent ^ ' ' 

Habits of personal maintenance and care"" . * 

Realistic appraisal \of sSlJf, acc^mpani'ed by feelings of personal. 

worth \* ~ ' ' s 

Dif f erent^iation of ftelings and appreciation of theij^ manifestations 

and implication \ A ' ^ ' ^ 

Sensitivity and^under*^*tanding in social rexationships * # 

Positive and af f ectionat-e personal reLationships- 
Role perception and ^appreciation 
Appropriate regulation of antisocial behavior 

Morality and prosocial tendencies'. - . ' 

^Curiosity arid exploratory behavior ' ' ' 

CoHitrol of attention 

Perceptual skills r - ' . - 

Fine motor dexterity ' ' ^ 

Gross motor skills ' ' .• ^ * 

Perceptual-motor skills - 

Language skills _ . , ^ . " 

Categorizing skills / . . * ' ^ 

rtemory skills ■ ' ^ 

Critical thinking skills * • ^ \ ^ 

Creativje thinking^^^^llT^ - , 

Problem-solV'ing skillV -^ . ' ' * 

Flexibility in the application of inf ormation-^process'ing strategies 
Quantitative and relational concepts,^ understandings', and Skills 
General' knowledge _r . ^ ^ " ' - 

^Competence motivation ^ ^ ^ * 

•*Facility^n the' use of- resoujfces f or learning and problem-solving 
Soitte positive attitudes toward learning and school experiences 
, Enjoyment of humor, play, and fantasy • . » 



In 1973 tThe Rand Corporation wa? asked to design a natidfi^l, 
evaluation of Head Start> and this task included ^recoiranending 
meatsures to assess social pbmpietence (Raizen and Bobrow, 1974a) A 
The result was' a large' set of depen'dent, variables covering a 
narrow rarige^ bi socially competent beJiaviors (for which there 
were not aiway? adequate measurement procedures) . Even with 
the large number of measures recommended by. Rand, only certain • 
aspects of social competence were included. The report points 
out that the definition of social competence must be a function 
.of . the"* specif ia roles that are required of the cJiild and' must 
be measured in relation to the context in which those roles are 
manifested. By arguii&g that Head Start is-a "preface" .to the- 
role of pupil and that Head Start-eligible children are probatly 
less -prepared for the role of jj^pil as c^efined by the dominant 
culture, the Rand report restricted the definition of ^social 
competence to. "effectiveness in the role 6f pupil" (Raizen and *' 
Bobrow, 1974a, pp. 17-18), 

r 

Although the 'role of pup,il is clearly a concern of the 
architjects of Developmental Continuity, restricting social 
competence tc^ompetence in that role |vould seem'' to be too 
narrow when compared to th^xj^ore inclusive list of competencies 
described by Anderson and MeSsick, and when compared to the 
Office of Child Development's concern with the child's "Everyday 
ef f ectivenese in dealing with his environment and 2^esponsibil7 >. 
,ities in school' and -life." Competency within^ the $chool may ' 
entail quite ' dif ferent skills from competency in the out-of- 
school environment, ^and'- it seems that successful accommodation 
by the child^ to- school is not suf f icienf^to insure the low 
inqome child the optioja of successful participation in his/her 
home and out-of '-school environment. The Head Start-elementary 
school cooperation required. for Developmentai Continuity also 
provides for the possibility, that schools^ might have to 

change in order to enhance a chiJ^dlSj|^ social competence. Tjius, 
emphasizing "ef !£ectiveness in the r^le'of pupil" might not 
allow for a change in the definit'ion of that role. 

With these consideration* in mind, a definition of gocial 
competence was ad.qpted for this evaluation based on the areas 
described by Anderson and Messick (1974)/ Although their 
definition is relevant to everyday effectiveness in the* majority 
culture of the United States, it attempts to be ^fundamental 
enough to avoid criticisms- of cultural bias 'by identifying 
behaviors which are more universally functional. That is, 
behaviors and attitudes have been identified' which are appro-^ 
priate for. the child's effective functioning both at school and 
at home and which are also cornerstones for adult mental health. 
Although there is as yet no developmental theory of affective ^ 
growth comparable to * thSit of 'cognitive growth in which^ to 
anchor theSe* attitudes and behaviors, Qualities have b&^h - 
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identified that would be an a'sset in most social settings 
and that would probably, enhance cognitive performance. Wever- 
theless, it is recognized that there are certain cultural 
values that could b6gpart of a child's h(bme life that may come 
'in conflict with some of the behaviors valued by Developmental 
Contir>uity. - For example, a child who is taught unquestioning 
respect £or authority at' home may -haye some' difficulty 
when encouraged to be more **self -direct^ing" by teachers* This 
conflict may not be resolved, but sHbuld be acknowledged. 

The categories "bf social competence have ai;so been 
influenced by the work o^ Whitfe and Watts (1973) at Harvard 
and thQ categories of' behavior used in the observational 
instruments developed by Ogilyie and Shapiro (1972) and Martha 
Bronsori (1975)^. The result of revieving these different 
a.t€empts to define social dDi;np$tence was the^ identification 
of 23 areas classified under five 'dimensions : six broad areas 
of SjObidl-emotional competence, five of psychomotor competence, 
five of language, six d|f cognitive-, and one for health and 
nutrijtion. These area4 are listed in Figure 2. 

Goals for Parents, Teachers and PDC Staff ^ i 

Of particular concern in this demonstration project* is the 
effect that Developmental Continuity might have on parents, on 
teachers, and' on other Jlead Start and sch'ool personnel. 
Developmental Continuity expects teachers to become mtore 
involved in a cooperative process of educational planning ^ , 
and to become more aware of *the needs of children at all levels 
£rom Head Start through grade three. Patents are expected 
\o become more 'involved in the educational system, in terms 
of participa^tion in the educational process and in decision- 
making roles.. Teacher and parent attitOides migJit also be 
expected to change.' Opinions of pCD program staff an,d of 
several* consultants were' incorporated with in^j&tmation ^rom 
previous evalaation studies to develop a ,list of important 
goals for parents and teachers. These are presented in Figure 
3 arid are discussed in the approptiate sections of Chapter III. 



DeVelopmentral Continuity T^oals 

Although the definition of measures for this evaluation 
has .'b'ene^ited frpm the previous work just "described, it is not 
likely that the definition of social* comp.etence developed £or 
the Developmental Continuity e^valuation, or the way in which 
.iL isfnperationalized,* will be generally acceptable beyond the 
P!)C context. ThiH is partly because in addftion .to conceptual 
'con.s Lderat I on.^, the particul^ir goal^ an^ concerns of Project 

-luont^a } -lit inui ty on both the national "and 'local levels, 



' Figure' 2 

Areas of Social Competency Defined for the 
^ ^ • Developmental ^:ontinuifcy Evaluation' 



Social-Emotional DevQlogyient * ' 

--- Realistic self -%aj)praisal,. -"Accompanied by feelings of ■ 
individual worth 
Self-directing; feels he/she can" influence the outcome 
o^' events . t . , 

» Learning hpw to learn ^ . ^'^ 

Social problem-solving ^ / , . ^ 

Recognition of feelings in self and others; sensitivity 

to and understanding of oth^s 
Positive schpol^' attitude 



Psychomotor Development ' 

Fine motOr dexterity 
Gross- motor skills * 
Perceptual skills ^ \ 

Perceptual-motor s}tills * ' . * 

Auditory skills . ^ ' , 

Language Development * ' ' 

* General language use 
^ Aural comprehension • " 

Descriptive competence , ^ ' . 

Functiorfal oqmpetence • . ^ 

Productive competence ' ' 

Cognitive Skills ^ ' ' , . i 

Categorizing , ^ , • , 

Memory * ^ ' ^ ^ ' ^ . 

Problem- solving , ^ / ^ ' * ^ ■ 

Flexibility, in the. application of information pi^ocessing 

strategies* ^ . ' — ^ * 

Quantitative and relational understanding skills ^ 
School readiness' - ' ^ ^ 

' Health and Nutrition - - , ' - i . ' 

Child develops better eating habits, is- free from disease 
and attains a level'of positive health 



^ • Figure 3 ^ \ , « 

' -Areas- 'of Expected Impact on 
Parents, Teachers, Staff and Institutions 



Parent Outcomes 

Participates, in school and classroom activities 
Demonstrates ' understanding of, a chJLld's developmental 
^ucatidnal process 
\ Provides 'input into school decision-miking and prqblem- 
- solving activities \ '^.-^ 

Increases personal development through participation^jts. 
a decision-maker and problem-solver 

■Teacher Outcomes * , 

Provides' instruction, hatching child's developmental 
. learning level ' ^ ^ . 

Creates classroom environment conducive to dev3lopment 
of social competency ~ * . 

• Acquires knowledge of resources available to meet needs 
of PDC child and families • ' • ' 

Provides activities for bilingual/bicultural children 

Staf f-as-a-Gf oup Outcomes 

♦ 

Staff member's interact with members of differing grade 
levels \ - ^ ^ ^ 

^ Staff members' t)lap and develop jointly ecfucatfonal and ■ 
program goals- for children, parents and themselVe^ , . 
Staff members commonl^ gain competencies in groi^ 
problem-solving and dedision-making technique^ 

Institutional Change Outcomes 

Consistent staff and parent interaction ^ 
United effort'by teachers, staff and parents 'in determini 
• ^educational goals consistent actoss grcide levels 

Integration of Head Start and Elementary school 
philosophies and services* 
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have tbeen considered in developing the 'measurement s^trategy. 
To oStain,^oj^e detailed information on program goals than^^^as , 
available in the program Guidelines , a "PDC Program Goals 
Questionnaire" 'was developed. ^ The questionnaire contained 
s.tatement%.aescribing the 25 child social competencies listed 
in Figure % 18 teacher or Pt)C staff goals^ and 10 goals for 
parents, "•Two types of responses were elicited*^ First^ staff 
were asked tb rate each of the individual goals on €he' follow- 
^ing §cale: ^"m^^H emphasize," "impiortant but not possible," 
or^* "will\notLemphasi*e — not important." Second, they were ' , 
a*sked to list the five "most important" goals for chil4ren and 
the- five, "most important" for teachers and' parenl:s. The 
quee.tionnaire was 'explained to each of the PDC project coor- 
dinators at a national meeting in May 1975, at which time they 
were asked to work with their staff to complete the^, question- 
naire 'in a way that would represent the, opinions of the local 
program. in addition, national OCD staff were* asked £o 
complete the questionnaire in terms of the naticjndd ?DC 
perspective on .goals and priorities. ' , . . 

Eleven sites completed and returned, the 'quest iannai^re 
the national ^office-^di-d not.- 'Thus,-trfe priori t4es discussed 
here represent local program goals, although na'tional OCD input 
was obtained initially- and influertced the statements that were 
included in the questionnaire'. The purpose of the analysis of 
responses to the goals questionnaire is twotoTd: first, ^here 
there is considerable agreement; among' pr'ograms, this provides 
Tevidence" that those goals should b^ a'ssessed in the basic 
measurement battery; ^second, where-^-^-trtere disagreement, this 
suggests -that site-specjiiflc measures shoi^d be introduced so 
that the evaluation^ can be relevant to lobal concerns. The' 
fi,rst analysis ot respons,es was ^ in ^terms of* the goals rated as 
most Important. Figure 4 lis*t*«^e goals ^^ej^cteii as most" 
important fOr children according to the frequency with which 
sites selected them* • - , ' ^ 

The sites that responded ranKed 'five of tne six ^giGial- 
emotional aspectl^ *pf social '-competence among" the, top eight 
5dals that their ^program intended to emphasize.. None of the 
five* psychomotor g^als was -i^ncluded among the t®p eight. Of" 
'the five language 'goals, only general language use was empha- 
sized, arid it ranked first overall with 8 of the 11 sites, 
listing at among their five most important goals. \0f tKe six 
cognitive goals, problem-sol\y.ng skills was considered 4iQ^ be 
1:he mast important and it was^ranked second overall £unong the 
child goals (listed by 6 sites). Three of 'the other cbgivrtTive 
goals wer^ not considered "most important" by any site/ and 
the other two were ^important in only one or two sites. Health 
and tiutrition and Self -directing wera tied for 'third in the ; 
rankings.* These were followed by the social-emotional goal^ 
of 'learning how to learn, realistic self -appraisal , recognition 
of feelings', ^nd social cpr(3blem-solving. 



"Most. Important" Go^ls fOr Childreji ai Rated by 11 PDC Programs^ 
• , * - ■ . - 

- ' ' - ' ' _^ , r - z - f 

Child Goals Listed as "Most Important" by Five o r .More Sites: 

' ] — 

• General language use ^ ' * . , - 

• Problem-solving skills 

• Setf-directing; feels he/she can influence the outcome 
of events 

• Health and nutrition , 

Child Goals Listed as "Most Tmportant" by Tvjo tb Fdur, Sites :. 
# 

• Learning how to learn 

• Realistic self -appraisal T accompanied by feelings of ^ 
individual worth 

, • Recognition of feelings in self and otheril^; sensi^tivity 
to and understanding of others 

• Social problem- solving , - ^ 

• ^ 

• Positive school attitude ^ ' 

Gross motor skills 

• Perceptual motor skills 



U.isted in order of the number of sites selecting ttie goal, with 
^the goal selected by the greatest number listed first. 
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\ Of the 28 teacfier, staff and parent . goals/ the staff goal^^ 

ranked -fap^rt important by the greatest number of sites out • 

'Of 11 sitie^) w^s .^the goal that staff be better able to individ- 
ualize their approach to children (see Figure 5) . Parent input 
in decision-making regarding the total school program^was 
listed ^s the most .important goal to, parents by ^6 sites and 

^parent^ input' ipto •eci^ionsr regarding the j^rogram fojj^^elx ^ 
child \^7as listed by 5 sites. ' - , 

Another perspective Sn program goal priorities was obtained 
from the |gart o'f the quest ionnai^^e thKt, asked program staff to 
rate eaclTf individual goal on the i^hree-point scale 'describe^ 
ab6ve. A number of programs saw various social-emotional goals 
as impossible (even though they might be important goals) / ^ 
particularly the goal of children becoming more self-directi«g . 
'Anoth^' area frequently seen as impossible ^ was the cogniti^^ 
area where all but one of the goals was seen as impossible by 
one site or another. Given the emphasis on health and nutrition 
in He^d Start and in PDC, it was surprising to^ find two programs 
citing health and nutrition, goals as not -"possible to achieve". 
On th^ other ;hand, all^ sites saw the ps^x:hom'otor goals as possible 
to achieve whereas it might be expected that educational programs 
would have lj.ttle influence on psychomotor development. Only two 
sdtes saw any staff goals as impossible, but one site did list seven 
of the 18 staff goals as impossible to achieve. ^The goals for « 
parents were almpst unanimously seen as gossfble"^ accomplishments. 

, Ai^other outcome of . the goals quest:ionnaire "Was an indication 
of the goals that woulc^ not be emphasized or would be considered 
as not important by the?, programs. Almost half (5) of the^ites^ 
" responding to the questionnaire said that nonfe of the goals was 
"not emphasized." T^e sites that did consider some of the goals 
^Q^^.be unimportant were most likely tg feel that way about t>he 
social-emotibnal, language and cognitive areas. The least im- 
porx^nt social-emotional goals, judging from these responses, 
seemed to be competence motivation, learning, how ^o^ learn, and 
recognition, of feelings in self and others.. The responses to 
the language area were largely non-bilingual prograi^s , responding 
tn|rt goals regarding bilinguaKLism. were not important. Iri the cog- 
nitive area, three sites .considered four or more of , the .cognitive 
goals to be unimportant; these tended to be the arejis of categorizing 
memory, problem-solving, and fleMbility in thfe application of 
information processing strategiesX " ' ' - 



Figure 5 

, * ^ * ^ ,* 

"Most Important" Goals, for Staff and Parents as^ 
* "Rated by 11 PDC 'Programs ^ 



S taff and Parent^ Goals Listed as^. "MoSt Important" by F-ive pr 
More Sit es: 

• Staff is better able to provide differing experiences for 
.^children, matched to the children*' s needs; staff utilizes 

y 'resources a^^propl^iate for individual thildren. 

• Parents have more input into decisions about the to€aI 
school program for all' children ' . 

f 

y . • Parents have more input into decisions about the school , 
program j/or their child 

Staff aijd Parent Goals Listed as "Most Important" by , Two to 
Four gites : ^ _ . ' • 

• Staff h^s greater awareness of child development in terms 
of emotional needs and social competencies from agj 4 to- : 
8 years - \ ^ 

Parents feel more comfortable in interacting with school 
staff 

• Parents participate in more, school-related ^cti^ities 

^ Staff is' more aware of. total PDC program for children aged 
4 to 8^ years, rather than just tl^ area of their own res- 
ponsibilities . ^ " 



• Staff is aware pf and usfes^methods of positive social re- 
inforcement for children 

• Staff members plan jointly for individual children and _f or 
gr^^ps of children, developing commonly held and understood 
•values r V ^ ' 

r ' • » • 

• Parents participate in more 'school-related activities 

• Staff interacts more with parents of children in the class- 
room, at meetings, in home vis-its ' ^ , * 



^Listed in ordef of the number of sites selecting the goal, with the 
goal selected by the greatest number listed first. \ 
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Literature Review . ; , . 

^ The problem of se;lecting the most appropriate instruments for 
measuring the aspects of social competence designated most important 
-was addressed within the general constraints of evaluation . research 
discusaed in Cljapter II. ' Measurement considerations that are 
specific to the methodological or conceptual issues in ^ particular 
area^Will be discuss edj Within^ach category of social tompetence 
in Chapter III. ^""'''^ . ' . - ^ 

* if 

- Once the important aspects of social competence were delineated , 
a -thorough literature ^search wais initiated, to find appropriate 
measures. This included the following sources: 

• Research reports on Planned Variation Head Start (e.g., 
Smith, 19 7 3) : ^ ^ 

• "Reports of the; Home Start evaluati'Dn study (e.g., Deloria, 
• et al . / 19-74) y ' ' - * 

• Evaluations of the national Follow Through project (e.g., 
Sorenson and f^adow, 1971; Emeri'ck, Sorensori and Stearns, 
1972; Cline, 1974) ^ % * ' 

• The Rand Corporation report on social*,coiupetence (Raizen 
an.d Bobrow, 1974a) * 

' . ' 0 

^# ^Instrument reviews (e.g., Btitlet, et al., 1971; Walker, 
19 73; Johnson and Bommarito, 1971; Robinson and Shayer, 
1974;-Buros^ 1965, i972; Hoepf^er, Stern and Nommedalf - 
' 1971). ^ ' 

• • ^ETS Head Start longitudinal study (e.g., Anderson, et al . , 

1968)f • ^ ' * 

Numerous other articles/, reports and papers were reviewed; 
many of th6se are referred to in the^ discussions of 'specif ic 
measurement areas in Chapter III and are included' in t'he- r^afer- 
ences. ' ^ • ' « 
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^* Recommendations for impact measurement 



This chafer presents the background, rationale-' and ifecommen- 
^dations for the measures to be Used in assessing the .impact of. 
?^°-'k'^^ Developmental Continuity. "The discussion is' organized by 
the broad program goal areas: social-emotional development; psycho 
motor, health and nutrition; cognitive krxd l^Tnguage development; ^ 
impact on teachers and parents; ^^nd bili%ual/bicultural impact 
goals. For each of these areas the imjloi^ant constructs are de- ' 
scribed, the pQ tent iai measures are discu^^^-and the reason! for 
selecting and rejecting measures are reviewed. * • 

< 

A description of each recommended measure, with information on 
-its^reliability, validity, practicality, etc., is included in the 
appendix. . ■ * . 
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Measured of gocjajf Emotional Development 



Defining Areas of* Social-Emotional Compebe ace • ' 

[ ' [ ' ^ - " * " 

As, indicated in QJaapter II, the "comprehensivei paper by Anderson 
and Me^sick provided the foundation for identiffKng the- most impor- 
tant aspects of child social-emotional' competence. Also influential 
were the Rand report- and the findings oT Burton , White, Bernice 
Shapiro, and Martha Bronson at Harvard. After. reviewing these 
sources, six bro^d categories of^social-emotionaH competeric^e of 
preschoolers were 'dferived: 

'a ■• Eeelin^s of individual worth accompanied by -realistic self- 
^ . appraisal ; " • 

• Self-directing, feeling he/she can influence the outcome of 

events: , , ^ r 

• Learrfing how to learn, competence motivation; . 

% " • R,eco'gnition of ^elings in self and others; ' ^ 

• Social problem-solving, incUid,ing self-assertion; * • * 

• Positive school . attitude. ' ' 

• '-x. A di$cwssion of eaqb of these areas, and possible measures 

for them,, follows.. Table 1 provides it 'summary of how each measiixe 
'• was judged accordii^g to the sel-ection criteria:, 

\^ ■ Feelings gf individual' worth Accompanied by' realistic self - 
I appraisal.- This area, comm6nly summarize^ by th.e'term "self-con- • 
cept, includes the avoidance of extremely negative self-depreeia- 
, ti5n even if the child is -at a rather low level of proficiency, as 

well as an awar.eness and appreciation of his/her "own -cultural back^ 
ground^». The* importahcfe 9f. positive self-concept and realistic 

T^PP^^^sal has long been recognized >by child deveXdpment spe-" 
cialists. Head Start staff* Snd OCD. Eowever, the difficult^ of ob-' 
feayning a valid indicator c5f self-concept, -especial\y for- young • 
.children, has become incr^afj.ngly apparent. \_ 

"^1 



.u' ff^^^^^K^^^ difficulty with the cpnstruct of ^ self -concept- 
is the^ltipli51.ty of ^dfef initiohs .• Many critics (Coller, 1971; 
Crowne and Stephens, 1961) have concluded that what are called % 
self-9oncfept measures actually assess many- dif feg^nt constructs. 
No agreed upon operational d'ef4.nition of selt-gd%ept exists*," Z ' 
largely because' there is no* adequate theory nithj^-which it can - 
be based. As- a result there, are a great variety of instruments ' 
and techniques for narrowly defined aspects Of self-concept, sd"* ' 
that "It is likely to be -defined as. 'that which a self-concept . 
test measures'" (Walker, 1973). .This, of course, m^s the *, • " 
selection of any one instrument- as a -measuretbf prdgnam ef'f ective- - 
nes's" especially problematic. a' - - , •• ' . 
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Several measures either recommended or used jl#L large-scale 
'evaluations were exai|Lned .and found wanting (see Table X)*: 

, • Children's Self-»Social Constructs Test:" Preschool Formr 
Self-Esteem Subtest .(Lon<J'and Henderson, , 1970)-; ' 

• Tennes^sea' Self-Concept Scale* ' (fitt-s 19«4) ; - 

• Piers-Harris Self-Concept Sq^le (Piers' and' Harris, 1969); 

• Brown IDS /Self-Concept Ret-erence Test i3rown, 1966) ; 
Faces Scale (in Walker, 1973). 



The first was recdmmdended for use, in the national battery by Rand 
ia their final report; it was rejected ^or use in PDC on the basis 
of questionable validity. The child is asked to choose^ a circle 
from^a column of f iVe .cirp les; it is unclear that choosing a circle 
closer tt) thje top represents "Higher" sGflf-esteem for a child. ''The 
second two were 'recommended by Rand in their preliminary report 
and dropped in their final report, presumably because they a? e' de- 
signed *-for an older population and would require too much develoj)- 
ment for *preschoalers . ' . . ■ ' ^ . ' . 

* i • ^ ' . 

The Brown Self-Concept^ Test has been widely used (Boger and^ 
Knight,. 1969; Walker, Bahe, and Br.yk, 1973; Emrick, et ,aL, 1972; 
Shipman and Gilbert, 1972). Boger^ and Knight* questioned the. extent 
'to which their data' were confounded by the effects of s.Qcial desir- 
ability, ^nd Walker, et al., sl^cited that "three large-scale studies 
found that the scojfes were negatively skewed and showed a ceiling 
effect, indflfcating that young children have a strong tendency to 
select positive, 'socially acceptable' attributes." It was also 
felt that this was more of *a cognitive or language *test -for younger 
children (who have trouble with longer items ah^ double negatives) 
And that' it was -culturally biased (Walker, et al., 1973).. There- 
fore its appropriateness fc^r PPC is doubtful. ' / 

The Faces Scale is designe4<to measure self-concept: ;with 
regard to school and was used i,n fcv^o pilot Follow Through^ studies. 
(Emerick, et al;, 1972). , Correlatidt^s^With the Brown and'athe^ 
sooial-emotional measures .were . low, -biitwjjpre importantly, 
reliability indicators v^are low. ^' ' 

The inadec|u^cies of these available m&asu:pes aftd a reluctanq 
to ertgage in ^^ren^ive pilot -work on a construct which is so ' 
difficult tp define made the choice of 'structured observatioj|3 on 
specifiable behaviprs appear to be the most valid measure of^ 
9elf-Goncept . ' Thus, it was decided to-design an observation ^ 
procedure for this evaluation. The initial steps in develdpjlng / 
the, PDC ClaBsroom Observation System are described bej.aw. 

^ , Self-djirectinq,^ feeling he/she can influence the outcome of 
events -(loeus-of control) .^ This involves the chiXd^'s setting 
his/her own goals', taking ^some respons^^lity for. skill acquisition 
ar)d self-care; e3j:pecting that his/h^r behav;ior cpurd phange the • • 
probability that"rei^nfo|i^ment would occur (that is, feeling res- 
ponsible- for the positive or Jtiegative responses of others) , anci 
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feeling he/she can direct his/her ovm behavior,, avoiding' a feeling - 
of powerlessness. Locus of control has became increasingly popular 
. with researchers, in part because of its wide applicability to»a , 
Tq?^?^ phenomena and its social rele^janc^ (Robinson and Shaver,' 
1974). The relationship of internal locu^s of control to academic- 
?SAA^''fT'"^"\^"'^ ^^^^"^ valued educational outcomes {Coleman et aU, • 
1966; Nqwicki and Roundtree, 1971; Rotter, 1966; and Chance, 

makes it of particulax ijiterest to educational evaluators. 
Moreover, a child's ability to' become self-directing seems 
intrinsically worthwhile to mAny people and was ranked highly 
among individual site's responses .to the PDC Goals Questionnaire. 

. A number^ of measures were considered ' for use or fdr m'odifica- 
1 1 on : 

• , Intellectual Achaevement Responsibility Questionnaij;^ 

(Crandall, Katovsky and Crandall, 196-5; modified bV ' 
■ . Rmqelheim, Bialer and Morissey, 1970) 

,v • Locus of Control Scale (Hess, sliipman, Brophy ' 

. and Bear, 1.969) t . 

• Nowi»ki-Strickland ^Locus of Control Scale (Nowiciki and - ' 

Strickland,- 1973) 

• Stephens-Delys Reinforcement Contingency Interview 

(Stephens and Delys, 1973a) 

t scale designed to tap chiWren's beliefs 

• • succeL and^f a? -sPO-^ibi l±'ty for intellectual academic 
success and failures; it is suitable for grades 3 through 12 The 
T^tn^^/^ Ringelheim, et al. is a shortened version of the 

lARQ developed specifically for use with the mentally retarded 

' Tar^V'TiV^'^rf''^' measures employ a. forced-SJoicf ' 

tormat which has b^gn a source of dissatisf actio;) for some re- 
search^c^ (Rob'inson^nd Shaver, 1974) because of the difficulty 
' ^htJn haye-m responding to-jt., Crandall pointed out that 
' n^tJ^r"- °^^v^^^ ^ ^^^P ^n<3 thfe two alter- 

ed al iSfi^J ^° '"^^^ ^ meaningful response <Crandall, 

carfoAn t V'^ °^ Control Scale, although employing 

5 1/2 ?o 7^ % ^^'''"^f/? ^hil^ (it is aimed a^ ! 

fnliL J'ii suffers frfl the same, forced -choice • 

tormat, and therefore was deemed unsuitable for PDC. 

non^J^^ No'wicki-Strickland Locus of Control Stale is a paper- ' • 
pencil yes-no-; type test designed_f^r» grades 3 through 12. Al- - 
'W^^/o/?^ ^ "^f Robinsoji a.nd Shaver a974) to be. the "best 
measure of locus of gontrol as generalized expectancy presently' 
Tor^lt ^ ^ ^^%"ith childftn," itVas found to be'^morl ln f icult 
' ' ch'il'dSn? therefore inappropriate for preschool 

>- . ' ' - - 

" ' TP^^P*^^"^:'^^^^^ Reinforcement. Contingency Inte'rview was 

selected because it was developed specifically for preschool 
Children to tap a child's expectancy that his/her dwn behavior 
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, would change the probablli-ty that reinforcement might occur; that 
is, if he/she changes his/her beliavior, will his/her teachers', ' 
parents or friends' behatvior change as a result. It uses a 
f ree-i-esponse structured interview format allowing the child to 
ufee^ his^/her own language. Forty items haVe been used, but 'a 
shortened form of 20 items was selected for PDC purposes.. . Each- • 
Item poses a 'reinforcing-type event, e.g., "What makes mothers 
sraile?" Responses are cc isidered "internalVif the child .answers , 
"When I...", and "external" when answered, VWhen Daddy (or someone, 
other than self)...." The instrument has been -used quite exteri- \ 
sively with Head Start and Follow Through children (Stephens and 
Delys, 1973b). Because of the appropriate format of this mea^ure*^ 
for preschool children, its previous use with Head Start and » - 
ethnically diverse children, * and its relatively adequate psycho- 
^metric characteristic^ / the conclusion of Robinson and Shaver ^ 
•(1974) that this is the "most ^viable" measure of locus of control 
seemsjvarranted and i1:s,use in this .evaluation justified. - 

Learning how to learri . This third category of social -emotional 
competence involves the child's maintaining curiosity about his/her 
environment and developing an interest, in scljool-relatjed endeavors. 
It also includes lear,nihg how to follow directions, how t6 attend 
to relevant areas for an appropriate length of time and becoming ' 

^anare of what he/she doesn't know, as well as developing skills in 
using objects and peopi^e to obtain the answer. The child' shoirld be 
able to ^j^. questions of staff, of parents, -and of other children, 
and remaiT involved in a particular activity until some conclusion. 

.IS reached. Competence motivation, ot the desire for mas-tery of 
academic skills in' the absence of external pressure or rewards. and 
the desire for .competence in nonracademic situations, falls within 
this category also. 

This obviously is $ broadly conceived category which owes cT 
grqat deal to Bronson's nonsocial '^executive skill" concept ^ -de- 
fined as ;• skill in choosing and coping with tasks," but it also en-' 
-compasses the dynamic aspect of motivation for competence and curi- 
osity. This construct shares the same difficulties of assessment 
applicable to ^elf-concept. The lack of relevant theory against 
which to judge the construct and the dearth of apprdpriate instru- 
menj^s to assess learning how to .learn in preschool children supports 
again the conclusion" that systematic observation techniques are the 
most meajjingful measures of behaviors relevant to this cpnstruct.' 
The Rand report recommended that "structured classroort observations 
■directed specif ically. .at' child-task interactions" be employed to 
obtain a valid indicator of learning how to learn. This is also • 
recommended for the PDC evaluation, if it is feasible to include 
categories representing this dimension in the c5Sservation instru-. 
ment which' is being developed. ' 5. 
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Learning how to leaiyi strategies might also be" evidenced in 
'the testing situation. Thus, several measures of test-taking 
behavior have been examined. These , measuifes have "the added 
advantage providing information on" the child^s behavior that 
can be used in interpretation of the tfest results. The Circus 
Behavior Inventory, the Stanford-Binet Face Sheet, and the ' 
High/Scope 'Pupil Observation Checklist were evaluated. A compar- 
ison of all three T5ee Table 1), indicated comparable psychometr-ic 
properties, but the Pupil Observation Checklist had the advantage^ ^' 
of having been, used previously in" a national evaluation and' so 
it was chosen^.. The POCIi is a rating scale of nine 7-point 
bipolar adjectives -developed for the Home Start evaluation from 
a 25-item scale used by High/Scope in.. Follow Through. Two 
factors labeled "Test Orientation" and "Sociability" were found 
consistently across several time ' points in the Home Start eval- 
uation.- modification of the instrument incorporating dimensions 
found in the Stanford-Binet Face Sheet will be developed. 

A ratiag scale tro be used t)y teachers, called the Child' ^- 
Rating Scale , incorpcgrating categoriek o£ behavior parallel to • 
the obse^rvation instrument, win be developed^or use in conjunc- 
tion with classroom observat^oi>s^'''Srr3^^tiie tester's POCL ratings.. 
Teachers are -often cdnsidered to be the best judge of their 
pupils, although they are not always unbiased observers. Thus, 
disagreejnent between the Child Rating Scale and, the other two 
in^tTruments would, not invalidate the observations or tester • 
r.atings, but agreement between the measures would tend t6 confirm 
tbedr validity^ ^ 

Social problem-solving, including self -assertion > This fjpurtli 
cat^^Wry of social-emotional competence involves the child's desire 
and attempt to solve social problems, the learning of pro-social as 
oppose^ to anti-social roles, and the developing^ of a ra^nge of pro- 
social (th^t is, neither violent nor submissive) alternative solu- 
ti^ons to real-life interpersonal problems. This includes the 
child's learning to .get his/her way appropriately in a grOup with^ 
out being a bi^lli^, deyeloping the ability t<5 assert one's right to 
fair play^'and developing the ability to gain access to others^ in- 
cluding getting and maintaining the attention of adults in socially 
acceptable ways. 

This category has perhaps the clearest relation tO' what is 
commonly^ thought of a^ social competence, and is integral to, 
Bronson's definition of social executive skill, which she saw 
as "the ability to control and ditect oneself adequately and 
constructively in social situations and the ability to- influence ^ 
others effectively in socially approved ways" (1975). It. does 
not imply mere compliance, but rather the effective use o£ 
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coping strategies. Charles Billings \ has stressed the importance 
of this cateogry, emphasizing "that' the child's learning\to control 
his or .her environment arid to influence others was an essential 
component of social competence and a necessary precursor to the 
use of social and political power, which is mandatory for an^ 
individual's or group's effective functioning in a democracy. 

It was decided that the assessment of a child's sobial 
problem-solving skil-ts^ would be . done partly by observations, 
partly by the Child l^ating Scale, and partly by the Preschool 
Interpersonal Problem-Solving Test (PIPS) developed by Spivak 
and Shure (1974) , This test is- designed to assess a child's 
ability to generate alternative solutions to two real-life kinds 
of problems, the first involving ways for a child to obtain 'a 
toy from another child, and the ^cond involving ways to avert 
the mother's anger which might result from damage to property. 
Since the two parts of the. PIPS test a^re highly inteircorrej-ated ' 
and together takes 20 to 25 minutes /to complete, only the first 
half of the te^t will be administered*;;^ This instrument \haCB High - 
face validity and, according to 1>he Rand report, "is eminently 
suited for assess ilig the extent to which Head Start increases 
prosocial behavioral alternatives" (Raizen and Bobrow, 197.4j - 

Recognition of feelings inr self and others, and sensitivity to 
and understanding of others . The fifth category of social-emotiwnal 
competence involves the development in tWe child of^ awareness of 
his/her feelings, .both positive and negative, and the ability to 
express themr appropriately. It also involves perceiving the emo- 
tions of others and responding to them appropriately, perceiving 
and accepting -sdifferences between oneself and others, tolerating 
others' viewpoints, forming close relationships with peers, arid - 
-responding positively to handicapped children. (-This , latter is 
directly relevant to the PDC goal of mainstreaming the handicapped . ) 

As with self-concept and learning how to learn, the problems 
of lack of agreed-upon theory and definition of -.JJ^^ecbgnition of - 
feeling" hindered the process of selecting appropriate instruments 
for preschool children. "Emt)athy '' may ' be a related ^concept , ^ but 
it was. excluded from the Harvard Preschool Proj-ect's construct of 
social competence because ^it did not dif f erentiate-^Detween children 
rated comp.etent and noncompetejit . However, recognizing one's 
feelings and those of others sliould be distinguished from empcfthy, 
which is usually def ini^ as ''takrlng the point of view of the, 
oth-er, " and:which may be confounded with egocentrism in pre- . * 
schoolers (Borke, 1972; Chandle*r and Greenspan, 1972) . One measure 
of "empathy" does exist for preschool^ children (Feshbach and 
Feshbach, 1969) , but administration procedures <?alliag for the 
use of slide projectors- and the verbatim recording of. child's ♦ 
responses make it impragtical for a national evaluation. 
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« Because of the difficulties in* assessing this construct in 

preschool children ^ i*t was decided assess it by classroom- 

observatiorii^J^l!^ teacher ratings. , 

^ ' " ' \ • ' 

P osa^^tl^e ^^jsOjOol attitude .^ The final category_of 'social- 
emotional competen^^^^includes r accordijig tb Anderson and iTe^sick -» 
the child having a posi4^'ve* attitude toward some things in school 
and not having a gener^^i^ed negative attitude toward most school 
experiences^ The "socially competent" child feels comfortable 
in school^ not thre^te^ied or anxious,*^ and likes to come to school. 
He/^he talk's . freely . tof all children and gtaff^in school,, not just 
his/her own teacher and children of his/her own age level. 

The ^iscu^sion of attitudinal constructs in/^the Rand report 
clearly sets forth the hazardous nature of attitude assessment - 
because of the tenubu,s relationship • between attitudes and behavior.* 
Furthermore, as Walker warns, there is a "dearth/of instruments 
suitable for young children" (Walker, 1973) . Consequently it-^is 
expected that archival data, such as number and kind of ajDsert^es, 
number of visits to the school nurse, tardinesses, and disciplin- 
ary incidents, might form the basis of attitude assessment. Even 
if the relatiqnBhip/ between these behavior indicators and atti- 
tudes, toward ,schoo]^',is not completely straightforward, these 
behaviors are of m<pre. consequence to the school and to the chrirld 
than- are the attit/udes.^ - « > 

^ . r ' ' . ' 

Because it ils impartant to attempt to assess positive- school 
attitude, another technique is being recommended for pilot testing. 
A brief self-repi^rt instrument, which is a segment of the High/Scope 
Child .Intervie^^/used this year in a Follow Through evaluation, is 
available. In /an interview format the ch'ild is shown a sheet of 
paper with**five fa'ces on it depicting the range jfrom happiness to 
sadness • The /:hild is asked to point to the face that shows how . 
he/she wiU f^el about school next year, how his/her' "teacher feels 
about the- chiAd, -and how .the child feels/ about the teacher Or 
teachers. B£)gatz and Ball (1971) recommend caution in assuming - 
that disadvasitaged preschool children can recognize common .emotions, 
but. this Inneasure includes ^llwo'jpia^tipe items to ejifeure that, the 
child, understands the meaning .of fhappy" and "sad"'. 




Alternatives to Testing ' ' - 

— 1 — f 

The /review of- instruments ^available, for measuring, social and ^ 
emotional development has been ^singularly unrewarding but not 
surprisihg in view o*f the lack of social and affective developmental 
"*J4o^eover, as Brori3on (1975) has commented, "it can be 
jd that the current theoretical 'state of the art* in social 
nol^^onal development is * so primi,tive. that observation may 

best ch-ance to develop a reasonable theoretical approach.",. 
;i973) concluded, "The most reliable and validTmeasures 
)-emotional variables) available at the present time are 
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the observational, non-verbal 'techniques . " Therefore, 'it was 
decided to place' considerable weight on classroom observation 
for assessing several aspects of soci^J/-emt)ti©nal competence, and 
to complement the observations with teacher, and tester ratings . 

DevelophQrital Continuity observation system . Although many ~ , 
research^ers have pointed out the drawbacks o^ naturalistic obser- 
vations (e.g., Bronson, 1975; Herbert, 1970; Wright, 1960)^ the _ 
advantages to be gained in terms of specificity of -naturally 
"Occurring^ behaviors, the lessening of inferences required, and 
the elimination of artificial and. inappropriate demands on the 
child far outweigh the disadvantages. In this seLCtion^ the 
initial developments of an observa^tion system is describe*d. The 
system wa^ll be tried out in Year fl {1^75-^76) and refined for 
- use in 1976-77. At. that time d manual detailing the behavior 
categories and the observation procedures will be^ published. 

The choice of categories to use in the observation system • 
was guided* by a number of considerations. The 'first concern, 
of course, was that the behaviors observed reflect the social-' 
emotional goals of Pro ject Developmental Continuity. Second, 
those behaviors which had been found to differentiate, "competent" ^ 
from "incompetent" children, in the preschool^ and edTrly elementary, 
years in the Harvard Preschool Projeqt were examined (White, 
et al., 1969; White and Watts, 1973; Ogilvie and Shapiro^ 1973; 
^BroYison,. 1973, L975; Ross and Zimiles, 1974) . ^ "Ogilvie and , 
Shapircr's il973) Social Behavior Ch^klist and BronBon's '(1975) 
Social and Non-Social Executive Skill profile contain nvany child- 
adult and child-child interaction categories which appear to - 
assess those areas of social-emotional development important to 
PDC. ' - ^ 

N Another consideration was the identification' of frequently 

occurring behaviors. High/Scope Foundation staff who have been 
, involved in observing and working with preschool- and early 
elementary-aged children ^provided feedback about relevant "behaviors 
which PDC, observers could expect to encounter frequently. Because 
observers will only be in the classroom for a limited amoynt of 
time, it was agree^ that it would be impraotical to train* them to 
reliably observe behaviors which might seldom occur during their 
observation periods. <■ 

■ " - . » 

Additional considerations were the experience and skills of ^ 
the individuals being trained to use the observatioa system. It ^ 
was, expected that the obse^rvers would be paraprof essionals 
accustomed to working with children but unfamiliar with the 
techniques ,of -systeipat ic observation. 'Therefore objective, 
(' operationally defined categories were chosen rather than 'cate- 
gories^ which deperiCTed upon observers* in^ferences. Further, with 
only on^ week available in which to train observers, it was 
^ dotcided tha.t bioader, conceptually based categories would be 

more appropriate and yeild greater interrat-er reliabilities than 
narrowly defined categories which required fine discriminations . 
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Based on the above consideratipns , behavioral categories 
were formed by refining or combining categories from existing 
'observational systems, and 'by adding other behaviors appropriate 

to PDC goals (the categories are listed in Figure 6)-. It is 
. expected that the Resulting observational system is one which 
relatively inexperienced observers can be taught to use reliably 
within a short peribd of time, and which still addresses the 
social^-epiotional goals which the PDC evaluation is interested ^ 
in assess^ing. 

' As mentioned above, teacher ratings (using a set of items' 
designated as the Child Rating 'Scale) will be used in conjunction 
with the observation system. Teachers will be- asked to rate* each 
child using categories re'levant to social competence which are 
based on Bronson's (1973) Task an<jl. Social Competence Rating Scale. 
Although the problem of teacher bias in the ratings ife again 
" unavpidable, to the extent that teacher-observer agreement exists 
. on categories rated by both, some credibility could be attached 
to those categories rated only by the teachers. 

«> \ * 

Summary of Recommendec^ Measures for ^the Basic Battery 

^ The measures recommended for assessing impact in the social- 
emotional areas are summarized here according, to tlieir methodology. 
The measures are listed with cL brief summary Statement of -the con- 
struct being measured. ^ » ^ * > 

Child Tests or Interviews • 

« 

' - • Child Interview * , \ 

'J ' Attitude toward school \ 

• Preschool Interpersonal Problem-Solving Test . 

Social problem-sQlving/ - 
Recognition of feelings ' , ^ ^ ' 

, • Stephens^-Delys Reinforcement Contingency Interview 

Self-directing; locus of control 

* Teacher or Tester Ratings 

• Pupil Observation Checklist 

Sociability and task otifintation 

• Child Rating Scale ^ . j 

Categories parallel to the observation system 
Direct Observation * ^ ' . 

• PDC Classroom Obsetvation: System 

/ Feelings of ^individual worth - ^ 

Learning how to learn 
. . Recognition of feelings in self and^ others 

, (see Figure 6 fdr detailed jLi^t of categories) 
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> Figure 6 ^ 

■-^ • ^* ; 

Recoipraended Categories f6r the PDC Classroom 
^ Observation System 

Non- Involvement 

Involvement 

a. Social 

b. Non-social 

c. C6mfc(ined social and non-^cial 

d. ' Active % ^ ^ 

e. Passive 

f. Self-initiated or structured * 

g. 01;her-inii;iated or structured 

h. Mutually initiated or structured 

i. Gross motor , * 
j. Fine motor 

k.^ Non-mot6r' - • ■ • 

1 . Verbal ^ ' . - 

m.- Non-verbal . • ' 

Intera.cts with Peers (A^^tive ) --Positive or. Neutral 

a. Cooperative . „ ' . . . 

b. Controlling •.' 

Interacts with Peers (Active ) —Negative ' 

itates Peers (Passive) 
Uses Peer as*. Resource 

Interacts with Adults— Positive or Neutral 

a. Cooperative * 

b. Contrblling - ; % 
Interacts with Adults — Negative* 

Imil^tes Adults * t 

Uses Adu-lt as Resource • ^ , ♦ , * 

Role Play s / ' 

a. Solitary * , ^ v < ' . , 

h. Cooperative * . . • o 

J. 

Pride in ,Self „ , i i \ . 

a. Physical a^ttributes of possessions ' ^ 

b. Accomplishments or products ^ ' 

■ . ■ V' 
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* * Measures of Psychomotcr^DeveLopjQftent , Health ancj^.Nutrition 



Defrninq^' Areas' of Psychomotor Competence • * < - 

There is* considerab^^isagreement concerning the relation \^ 
oC ^psychomotor skills to social bompetence. Burton White (1973), 
for example/ has found only "qui-te modest** differences in ^motpr 
and sensory capacities be^tween children with high overall com*"- 
petence .and children with 4dw overall competence^. 'Since the 
development *-Gf- psychomotor skills appeals to be mor^ ihfluended 
by^aturation than ara'other domai^ of socfial competence, it 
may not be siqnif icantly affected by PDC experience, and the 
likelihood of finding program effqcts Jhas been questioned by 
sbrtle authori t ie,s . ^ ' - - ' . 

9 .Others believe that the five areas, of psychomotor skills ^ • 
|Outlined bG^low (see also '^'igure 2) are* important components of 
sogTal competenge. One reason £6r their importance may be that 
a child lacking in some bf these abilities could be 'differentially 
perceived by^-teachers\anci peers ^rjd be at a relative disadvantage , 
in mastering classroom-related skills''; this, in ,turn,^ may affect ^ 
later school performance . • . - - 

• . • ■ ^ ' 0^ . 

The five areas of psychomotor skills identified by. Anderson 
arad Messick as uart of spcial compet^ncg are fine motor^ dexterit/, 
g^oss motor 'skil].s, visual and*^ audiiory perception skill«|' and 
perceptual motor '^sl^SS'lls . ^ Fine motor dexterity involve^une • 
^ ability to" manipulat^^Anall objects. ^Gross- motor skills involve 
large muscle use f pr alfeiyities such' as jumping and bSilancifil|«.> 
Visual pefceptions^nvoli^Qs ■ discriminating between similar forms, 
and auditory percept&iQii^nvolves discriminating between similar 
sounds;* berth* skills ar^^ thought to be" important ir* developing 
competency in language ^and reading ""I^rceptu^l nfotqr skills 
♦involve coordin^at^ir^g visual, audirory,^ and motor b^havion in such > 
activities as' copying geometric forms and imitating gestures. 

Psychomotpri instruments were examined within each of the five 
tsul^ategories and judged ^or thisir -appropf iatene;ss (see Table 2), 
. Thfe mos# widely^ used and suitable *n\easur.fes (with selected references) 
are as fall9ws: * * * " ' - ^ . * * 

"^m Purdue Percejpttial Mol;or 'Siir\iey (Jamison, 1,97^") * 

• Denver Developmental Screening Test (DDST) 

^ Developmenta]<Tasks ^of Visual Motor Integration (4/MI) 

(rhissom, 1972h ' ■ ' ' ^ ' % ^ 

• ^ G^s«ll >^gross, motor tasks (Werner*, J965). 
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Ratings of Measur^ of Psychomotor Development on' 
Criteiria Tor ^Measureg. Selection 
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• Copy What You. See f rom ' CIRCUS 

• Auditory Discrinjination Test CoiCarlo, 1965) 
Children's Audi?tory 'Discrimination Inventory 

• McCarthy Scales of Children's Abilities^ 

• WPPSI and WISC 'lock esign ask/. ' 



m 



r 



>Input'was sought fromTeach of^ th^ individual PDC sites con- 
cerning the importance their program was attaching to psychomotor 
goals. None of the psychomotor goals was ranked among the*most> 
important thild goals>, yet no program was willing to give them ■ 
especially low priority. . ' , . 

In view of the possibility that an educational program might 
have little influence on psychomotor development, the relatively 
neutral local site e\£.aluation' of ' ^psychomotor goals, and the narrow 
scope of each psychomotor instrument, all were rejected in favor of 
subtests of the McCarthy Scales of " Children!' s ^ilities .arid the 
Block Design Task of the WPPSI and WISC. ^ , / ' 

The MSCA is a relatively ^ n^w te^ (McCarthy,, 1^72) with 
subtests for assessing perceptual-perf ormance^ aiid .motor development 
A number of factors? r^comme'nded the use of tSe'.j^SGA:. the 4ge range 
(from 2-1/2 .tK) 8-1/2 years), making it feasibly 'for «use in -a 
lcmgitu(^ina'l evaluation; its psychdmetric development, which 
appeared adeguate; its' standardization, which w^s^ carried put on 
1,032 children proportixDnately representative of -the' total popula- 
tion in 'terms of sex, race, geogr.ap^iic location ^hd SES levels; 
the apparent ease witfi which a paraprof esjsiOn^i, can administer- it; 
and its integration of psychomotor and cag^itive-language tasks. 
(Discussions of the cognitive* and langustge*^ subtests *^^f>ear in 
the next section.) . ' • 

Perceptual performance . SybliestS' ''from the /Perceptual 
Performance Scale and from the Motor Scal^ -were* selected on** the 
basis of appropriateness for PDC *g^)al^./" jThe Perceptual ^Performance 
Scale, "consisting of 'gamelike* tasks which do itot reguire the 
child to speak, assesses his reasdnin^ .ability through the manipula 
tion of materials". (McCarthy, 1.97^)'. -Both 'social and non-social 
competence scores on Bronson's Executive Skill Profile .shovred 
significant coprelation* with this . scales of i the MSCA* The subtests 
(numbGre;d in order of p^esentatioff in tt?e MSCA^ recommended for 
the basic battery are: ^ » 
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. ; Subtest ' ^ Description - 

\ 1- Block Building Child copies block structures 

built by the examiner. 

13. Draw-A-Child Child draws a picture of a child 

of the same sex. 

- 18 Conceptual Grouping Child classifies blocks .on the 

basis of size, cjolor, and shape. 

Three subtests were eliminated from consideration at the outset: 
Right-Left Orientation, because it was not recommended for children 
under five; Puzzle-Solving, Ijecause the WPPSI and WISC Block Design 
Task was thought to be a more powerful measure encompassing the 
same skill; and the xylophone Tapping Sequence, because it appeared 
to tap memory more thaji psychomot^or skills. Draw-A-Design' ^tSubtest 
12) was ^deleted after the complete battery was revieved and it 
^was necessary to reduce testing time; Draw^-Design was seen as 
expendable in view of likely redundancy with Draw-A-Child and 
Block Design subtests. » , , 

Block design . The WPPSI and WISC aiock Design subtest is 
recommended to assess problem-so3,ving. strategies "and conceptual 
maturity. It is mentioned here since' it requires the manipulation ^ 
6f small blocks and may"t>e considered appropriate for the perceptual 
motor area 4 

Motor 'pergprfhance * ^ The. I^otor Scale of the MSCA assesses the 
/Child's coordination, as he/she performs a variety of gross and 
fine motor tasks., .The recommended subtests* are : * - • , 

^'1^ " Subtest > • 'CbBSc'ription ' • 

♦ , • ^ ' 

•9. Leq Coordination • Chillier forms motor tasks which ^ 

involve the lower extremitifes, 
f . '^ such as v^alking backwards dr standing 

on one foot. 

10. Arm Coordination"^ Child^ bounces a rubber ball (Part I), 

catches a beanbag (Part ID^ 'and^ 
•throws a beanbag through a hole in 
- a target (Part -III). 
, . * - . ^ 

13.^ Draw-A-Child ' Child draws a picture of a child of - 

. . the same sex. 
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The first two subtests measure qross motor ability? the last 
measures fine motor coordination o* th'e ha'nd and fingers. It 
is recognized that the drawing task involves a strong cognitive 
component as well, and that it has also "been u^se^ clinically 
to assess the child ' s' per sonality . This is not the purpose - 
of its inclusion here, however, and McCarthy's short, pbjective, 
non-inferential scoring system will be used rather than an 
in-depth interpretative anal^is. 

visual and auditory perception . No auditory discrimination 
or visual perception measure is reciommended for the basic' battery - 
Since visual perception is involved in^the MSCA Perceptual* 
Performance scale and the WPPSI BlocJ^ Design test*, a test 
specifically for visual perception do^s not -seem warranted, and 
•auditory discrimination does hot appear'to be of concern to most 
PDC sites. To accommodate sites that are more concerned with this 
psychomotor area , -the* Wepman Auditory Discrimination Task will 
be made available as a site-specific option, 

* • 

DeTinmcj JVreas of He alth and Nutrition - t'^ - 

— 9 * ' — « • • 

- ^ The problems, of ^malnutrition and *ooor health have b^en a 
major focus ®f Hea,d Start from its inception; moreover, recent 
data have documented the relationship between good health and the. 
child's potential cognitive development (Birch and Gussow, 1970). 
The PDC Guidelines explicitly require that each site assess the 
nutritional, medical, dental, and social service needs of PDC 
children, locate community resources, and develop a system to meet 
these needs. Head Start requires medical, dental, and speech 
diagnostic screenings of a prescribed' nature as well as the 
completion of all recooimended immunizations and "dental treatment. 

Recommended procedulres . As a consequence of the Specificity 
and concreteness of the * performance standards , 'it is recommended 
that the' Of f ice.,i)f Child Development provide guideline^ tot 
standardized record-keeping so that child health information can 
be gathered .uhiformly from all, sites. •^Responses to the goals 
questionnaire reflected a strong emphasis on health and nutrition 
across all sites and an endorsement of the goal of the chi,ld's 
attaining not only a minimally acce^able criterion of health, 
but reaching^ a level of ^positive " ^ealth . In order to 'assess 
.these goals, the following "Measures are recommended, grouped 
according to goal and levjsl of attainment: 

' • Absence oC disease, freedom fnom correctable handicap 



Records of immujiizatipns {rubella, ^rubeola, munips, DPT, pol 



' ' TB exam ^ 

Dental 6xam for caries 

0 ' 
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Visual exam:^ Snellen and/or $3irectional letters test 
Audiometric ^cteening test for hearing loss 



Level »of 



po^i^ 



Lve health 



Height, weight 

Observation of amount of energy, vigor 
Frequency of absences for health reasons 
Sicknesses at school, visits to nurse ^ ^ 

Iron deficiency tests .{hematocrit, serum ferritin) 
Protein deficiency test (serum albumin) 

Better eating/habits . • 

Sample school menus ' 



Summary of Recomflnended "Measures for the Basic Battery 

• Psychomotor Development 

* Perceptual Performance 

* 

: Block Building- (MSCA) 

Draw-A-Chlld (MSCA) ' ^ 
^ Cojiceptual Grouping (MSCA) 

. . ■ Motor Performance " 

* 7 

Leg Coordination (MSCA) 
hrm Coordination (MSCA) 
I ■ * - 'Block Design (WISC/WPPSI) 

^ Health and Nutrition 

^Head Start, Program and School Records 

Records pf immunizations 
Incidence of^TB • 
Iron deficienqy tests 
Protein -deficiency test 
^ ^ , • Pental ex*am • . • 

Snellen test and/or directional letters measure* 
Audiometric -screening * , 

^ » Height 
Weight 

Vigor measure 
Frequency of absences ^ 
' SicKnesses at. school 
Sample school' menus 
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Measures of Cognitive .and Language Development , ^ * 

• • -Traditionally, -national educational evaluations have empha- 
sized cognitive outcomes as thjs major criteria for program success. 
In contrast, the PDC evaluation views cognitive and language 
abilities as only part of ^ many factors which comprise^ the child's 
"everyday ef f ectivfesness in dealing with his/her environment." 
Such a perspective acknowledges the acquisition of cognitive 
abilities as being interrelated with and necessary for the child's 

-psychomotor, social-emotional aj:id language development, but de- 
emphasizes^ cognitive growth as_the 'major goal independent of 
other goals. ^ - 

Defining Areas of Cognrtive and Language Competence 

The precise nature of the cognitive and language abilities 
which a child mus't possess in ord^r to "socially competent" 
continues to be debated! In part, controversy exists because 
the essence of 'these Competencies varies with chronological age 
and situational contexts. It is clear, however, that across 'all 
age levels, l:o be socially competent within the, school environ-, 
menb the child must acquire a set of skills which facilitate 
academic learning appropriate for his/her developmental level. 
These competencies are .known to most educators, and are repre- 
sented within Anderson and Messick's (1974) list of ^social^ 
competencies. They includd: 

^ • Attentional skills / 

m\ crassif icatipn/categorization skills 

• Perceptual skill#^^^ 

• Information-proces'feing skills 

• Evaluative skills , * '* . h 
Memory skills f . 

. Basic language skills ^' ^ - 

Although^ this list is clearly not comprehensive, the acquisi- 
tion of ' these ^skills may potentially predict academic performance 
or the ability to learn concepts and, in turn, social competency 
in the school environment. Moreover, it may be argued that such 
skills *are inherent in-'social coThpete,ncy in the home- or community 
environments as well. The- child's ability, to solve practical 
problems (e.g., fixing a broken toy) may in part be dependent. on 
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his/her abiiity to use skills deemed necessary for ac|^jiemic per- 
formance. For example, the child musb^first emJploy attentional 
and perceptual skills in order to per^'eive the problem, classi- 
fication or categorization skills in /order to define and communi- 
cate the problem, or evaluative skilAs for determining the most 
appropriate solution. This "feuggests thai an overlap^ exists 



^ f 

and practical problem- solving onyche other. 

While there appears to be^/feome relationship between profi- 
ciencies which predict' abilityVto learn concepts and ability to 
solve practical problems , a sl/ronger relationshi-p emerges 
between cognitive abilities and communication and/or language 
competency, j In order to effectively communicate relevant '\ 
observations about his/her environment, the child njust direct 
his/her at^tention to salient cues, detect similarities or 
discrepancies with existinyg knowledge, organize them logically 
and possess an adequate vocabulary and syntax to, express the 
observation verbally. In ^addition, there is a'-whole array of 
communication competencies \e . g . , lack of egocentricism, taking 
the listener's point pf view^ Whiab strengthen vthe existing , 
interplay among language and cognitive abilities. 

\ 

The complex relationsh.ip between cognition ,ctnd communicat?ion 
suggests that an appro52;;ia'fe 'approach for 'measurement Would 
the assessment of cognit|-Ve and language abilities* that serve 
as 'tjie basis for iicademic achievement, practical problem-solving 
and verbal competency. Such an ,appr<^ach receives further support 
from PDC staff and^ teachers who designated the goal's of "problem- 
solving" and "general language use" as important and indicated 
they were ermphasized by their programs. This suggests that at 
least some PDC clarSsrooms attempt to provide an environment where 
problem-solving and general language competencies ^re nurtured, 
and, consequejatly , program .effects mdy be observed when ^DC and 
non-PDC children are compared. In light of these theoretical. and 
pro<|ram issues, a brief description of the- three major cognitive 
•^nd language areas is ^aAered: 



among skills essential for academic performance 'on the one hand 



ias is >a^6 

. : p 

jnitive^con 



General cogni tive^ompetencies ^. This area encompasses^ the 
child's age-related ab^ility to attemJ to salien^t cues of stimuli; 
perceive units or forms as separate from their context; synthesi:^ 
units into an* organized form; apprehend the nature of similari- 
ties and differences; categorikfe objects or events according 
to their attributes; and use strategies of Information proce'fesing 
for appropriate reti^ieval. " 

( Problem-soLving competencies . This refers to the child's 
age-related ability to apply general cognitive competencies in 
order to identify the propter solution fbr a :problem knd to"' evaluate 
his/her own responses and products in the process. p/ 

• • \ . 
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Verbal competency . This area relates to the child's age- 
related abilities to verbally label objects and events appropri- 
ately; describe objects arid events speaking audibly and contt>re- 
hensibly; repeat 'italif ormation told tg -him/her; aftd make requests 
or give instructions, 

♦ 

Measurement Selection Process 

The* selec»tion process began with the review of cognitive 
and language measures utilized in other national evaluations of 
early childhood programs, those recommended by the Rand report, 
and those suggested by the panel of High/Scope consultants. Tl\is 
review process yielded a list of possible measures to undergo 
further 'examination for PDC relevancy. Table 3 pife*sents tKe^ ^ 
list' of measures rated according to the^lS criteria employed .for 
determining their suitability for use in the PDC evaluation, 

" Itie ratings in Table 3 make^ it evident that tests employed 
in previous evaluations fail* to meet several of the criteria. 
The primary shortcomings ^e that many of the tepts do not spall 
the total age range (4 to 8 years) of the PDC population,' are 
irrelevant to PDC cognitive and larTguage goals, do not fully 
represent geographi^ or. SES aspects of' the PDC population in 
their standardization procedures, or have*been found to be highly 
correlated with general ability measures, -54uis , ^ the criteria 
•employed to4select tests with the most desira&Ie characteristics 
considerably reduced the pool of .potential measures for the 
PI3C battery, ^ . ' 

^ Given the inadequacies of many developed measures, atnd 
considering the* constraints on developing new njeasilres^ a re*^^-' 
sonable course of action is to propose the use of carefully ^ 
selected subtests extracted from the a^;^lable cognitive and . 
language measures • By examining a variety of subtests it i6^ 
possible to select ones that more fully reflect the desired \ 
characteristics of the PDC measurement battery, 4 

Because --of the dangers inherent in separating subtests from • 
the context' in which they were developed, several precautigns 
have been taken, first, the tests were examined for desirabie 
psychometric characteris4:ic jlirecting particular attention to 
elements of the individual subtests. The subtests under* consid- 
eration from the WPPSI and WISC, all displayed acceptable internal 
consistency or stability coefficients and concurrent or predictive 
validity , independent of the total measures (see appendix) , 
However, because the validity and reliability coefficients of 
the MSCA subtests are nei.ther published nor available at this 
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Table 3 



Ratings of Measures of Cognitive and Lang^iage Development on 
Criteria for Measures Selection 
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Table 3 (continued] , 

jlatings of Measures of Cognitive and Language Development 
Criteria fox Meafiufes Selection ^ 
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^Summary-of JJeasures toJ Cognitive^ and I^ariguage ^asic Batter;y 



Subtest 



Conceptual 
Grouping' 



Vertjar Meitioty 



Block *De 



T^t 



jStimulus Materials, 
;se£/6f 12 ijlocks: 6 
squares, 6' circl€fc, each 
shape in vthree colors- 
and two sizes- 



GA 



.V 




Child's task 



Vei^baJ presentationJ^ySf^ 
sequence \o£ 3 ^and 4, w^j^B^ 



14-word sehtences and- a 
one paragraph story 



To Mrform various man- 
ipui^tions aiong the 3 
dimensions or color, size 
and ^hape according to 
verbally presented* 
instructions 

V . • t ■ 



14 flat blocks, sblid red 
on one 'side, 6 b Jocks 
solid/ white on. "cY^ Qther 
si&e, 8 blocks- half red, 
balf white i^iagonaliy) 
jOn the other side 



;j'o repeatj as-much of the 

timul us presented* as- 
possible 



"To construct *the appro- \ 
p^Rte design either froin 
examirter's demonstration J 
model car from model 
design pyfrtured on cards 
within fixed^ tirife limits" 
for each desjlgn - ^ 



Skills Asseised. 



Classification 
Categorization 
Perception 
Attention 
Understanding, , 
si?^, 
ghage 



color, 



Memo3|g 
Infoirmation'- 
processing 
Attention 



Problem solving 

Att^tion. 

Perception 

Evaluation 

Classification 



Administra- 

tion Ti^e 



10" minutes 



-20 minutes 



10 



minutes 

5 •. 



\ 



Admjfhistered 
to ^Bilingual 

ChildrPn 



Ves, wi€h 
modification 



Block Design ' 



Wise 



Verbal fluency 



^^^Obes, 4' solid coloi: 
faji||6 (blue, i^ellow,' red.,* 
white) , two diagonally 
split faces (r«d/whit©, 
yellow/blue) 



same-' ^s ^Qve 



same as above 



MSCA 



em- 



^^^^^^ 



Verba'l' deques tT^^Qr mem- 
bers* of a specific 
category > . * 



Ta. nanle as ^any stibordin- 
ate ^members as |5dssj!ble 
Hithin *20-^l|cc?Rd interval 



Clarification"^ 
Categorization 
Memory ^ . 
Evaluation 
Verbal expre3g*j.on 



10 minutes 
/ 



Yes 



10 minutes 



Yes y 



Opposite ^ 
Analogies 




Verbal' presenf^tion of 
siitiple aj;ialc5^ie§ 



To 'provide tTie missing 
word in an em-alogy 



Memory 

Attention 

Clas%rfication' 

Categoria^ipn 

Evaluation 



7 minutes 



No V/ « I 



*tirae,. some uncertain.ti^' surrounds the characteristics of subfeets 
apart fn€>m the total M6CA sui)3cales. Therefor^, unlike the^. ' 
WPP'S-r and^WISC, selectfi.on .of the MSCA subtests could not be- based 
' ° on •piycbometric *indicajtbr.s^ ^but bccurr^'d within the framework 
^ of soci^ competence deyelbped for, th^^s^ study, F^urther guidance . 
wfe pr6vided by a Head Start evaluation study (Rent'frow, et al . ~ 
*1972) which also extracted subtests from th^ M6CA to comprise ^ 
a measurement- battery. The results of this evaluation (N=64 )^ 
. . indicated that the subtests preferred for PDC correlated - . ^ 
<noderately (r=.57 to .70) .with the composite score. Evid'ence 
ofi the Mfi^A factor structure is available from KaUfmaxl (1973)-- • 
'and Kaufman and Hoidenbeck (19'73) . • , ' 

/ \ : • ; • . • • 

'Since so , many qf the , tests , initially conside*red were found 
to favor B> specific culture/ radical or socioeconomic group^^ a 
, • secpnd^precautionaf y meagre was' an extensive review of the 

liter^Lite, and discussions with bilingual/bicultur^i* consultants . 
These .procedures were- ^pacifically ^enacted .to identriTy^tich of 
the" preferred subtests exemplify dultural and, socioe^ConR\ic * 
"f airness'' . ^ Because of th^ importance and relevancy of this 
factor forjjthe PDC evaluation battery ,^ this "fai:r:ness" element 
r wa's weigt^ed heavily in making the final recommendations. 

^nformatron' regarding 't-he' influence of culture . and socioeconomic 
§tatu^ on V5/ISC/WPPSI end WSCA test performance were pbtaijied - 
. ' *frofn various independeht §mall, scale studies. ~ . 

Kaufman ^nd Kaufman (1973) , for example, designed and 
diorected a study in ordfer to.determine differences iri Black and 
.-White •* per fo-rmances on the 'MSCA, a critical study since only 
* * ■ limited data were provided .by the atandardi.2ati^n study. This 

study indicated performanfce dif f ereivce^g, favoring the White child 
on the W6rd "Knowledge and \umiSer Questions- subtests^ with older C^/ 
- ^-'children (6- to 8-1/2 year;s) . "Sincer these subtests appeared to 
hiahly dependent on' learned concepts or academic-attainment for 
^ "T^ire older levels^ It was cjecided to exclude any subtest that 
appeared to td{^ these elements ♦ ' ' ^ . , ' * 

^ MSCA subtests .- fhe McCarthy scales (McCarthy, 1972) wfere 

^« develop'ied to, assess • a 'Variety of cognitive- and motor behaviors 

of childreii from 2-1/2 through 8-1/2 years of age.* The content^ • 
V * 06 the"\ta^s wa-s designed to be Suitable foK both sexe^-cCs well 
' as for :scnildren frcTm a variety of ethnic, region^al, and Socio- 
economic groups^ The materials and questions are administered' 
- . individually- in a g'amelike manner. ,A11 subtests are easily and 
^quickly administered .to avoid taxing the young child's attenti6ii 
span.' Taking account lof these cons icfe rat ions those discussed 
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earlier, the following MSCA subtests are recommended for the basic 
battery of cognitive and language measures: 

• Verbal Memory ' . . 

• Conceptual Grouping \ ' , . ' " ' 

• Opposite Analogies ^ ^ ' , ^ 
Verbal Fluency^ ^ ^ , 

Each of theses, subtests is described ir^ Table 4, with information 
on the stimulus materials used,, a brief (description of the child-^s 
t;asR, the skills assessed, administration tiiitie and appropriateness 
for bilingual- ^children. ' * ' . , ' 

Blocic Design , The WPSi and' -WISC ' scales (Wechsler, ]/94 9 ^ 
and* 1967) represent a downward 'extension, of the Wechsler Adult 
Intelligence Scales. Sinde the WPPSI is appropriate for ages 4 
to 6 and the WISC is appropriate from age 5 through , adol,e;scehc^ , 
subtests from both can be used to accpmmodate the a^e range of , 
PDC. The WPPSI and WISC, typically fased, in clinical evaluations 
to calculate IQ, consist of 11 individually administered sub- ' 
testsr to assess verbal and cognitive performance. The materials ' 
were designed, to appear intrinsically interesting to the child' 
and have been used , widely across socioeconomic, ethnic and regiona 
groups. ' ' . . • ' ^ 

Considerakid^ 'research^ has jD^e;^'^ conducted on the WISC 'and ^ 
WPPSI (e.g., Littell, I9 60; 'Woo-Sam and Zimmerman, 1973; 
Ziftipierman and Woo-^am, 1972), but^there is little ^Information on 
th^ Block Design Subtest as apart from the scale score The 
Block- Design subtest does appear to be hij^ly correlated' with 
full-scale IQ, but somewhat more highly related to performance 
IQ. than to verbal IQ. Trie fact that it' is easily administered, 
brief, nonverbal and higlily reliable suggests^/its suitability for * 
inclusion iji a battery that, i§ attempting to assess, a wide^ahge ' 
of competencies.' ' ► , 

•i As a stable measure or cognitive problem-solving at all age 
levels, the Block Design sujDtest. can serve as" a useful covaria,te 
and as an entry-level sme^sure of PDC-comparison group differences. 

Summary of T^commended Mea-sjiires for the Basic Battery 

The subtests recommended are grouped according "to three 
general dimensions of competencie: • 

mm 

m 

General Cognitive Competence - 7 

Conceptual Grouping (MSCX) 
' ' Verbal Memory (MSCA) * 



Problem-Solving Coinpetence 
_ Block Design (WPPSI, WISC) 

Lang,.uage Competence - , ^ 

Verbal Fluency (MSCA) . 
Opposite Analogies (MSCA) 




\ 
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Measures of Impact on Parents and Teachers 



Heac^ Start philosophy has always recqgnized the significant 
rolQ,s parents and teachers play in affecting children's social'^' 
competence." Various Head Start and Follow Through models' liave 
active;ly'*encouraged parents' participation in school decision- 
making. Numerous efforts by Head Start Planned Variation and. 
Follow Thfough sponsors have been under tc^ken to help teacherd^ - 
increase 'their awareness of the particular neecjs of the lower 
socioeconomic, biling^ial, and handicapped child and, family. 
OCU tias 'designed goals* for PDC which are -consistent, with those 
of previous Head Start and Follow , Through pro jects em^ks'lzing ' 
joint parent and teacher participation in defining educational * 
goals and mailing educational decisTons. « These decisions will 
be primarily concerned with the key PDC requirement that the 
H6ad Start and elementary school teachers develop a coher^t 
and.^ continuous curriculum base.d .on the deyelppmental needs o-^ 
children from Head Start thrqudfh the third grade. /The purpose 
"^of the evaluation *wilL be to. assess the impact of PDC on parentis, 
staff and teachers in terms of attitude' and behavior change, - 
as well as subsequent changes in the school environment. ' 



Defining Prograip Goals for Parents and Teachers' - ' • " . 

The PDC Guidelines deal with parent involvement as a- ma jof 
component of the program and' also specify some issues in the area 
of staff 4teveloptnent. An examination ^of these Guidelines and ' 
discussAcns" with^ iocal dnd national PDC staff led to a definition' 
of outcc>ni^s in .the following areas: » . " • . 

-Parent outcomes: * 



Participates in school and classroom activities . fh^ # 
par^t perceives his/her role in school • activities ^and 
processes as providing the necessary bridge between homis' 
and school. This perception i-s translated into an actiVe 
involvement as a>-classroom volunteer, room helper, lunch 
room supervisor , 'vbluntqer tutor or 'other voluntary school 
roles . * - 



• Demonstrates understandiilg of a child's developmental 
. educational process . -The parent recognizes the acqui- 
sition of knowl'edge regarding his/her child's socioemotional, 
cognitive, psychomotor and academic ■ growth as enhancing ' • 

' his/her role as "facilitatbr of development.". This ^ 
recognition may be evident in the types of experiences and - 
materials available^in the hom^' or a possession of reaiis'tiq 
'expectations and aspirations for their child's academic ' ' 
aiChri^vement • • • - - - ^ / " 
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• ProN^rdes input intp school decision-making and prbblem- 
solving* activities ,, The parent perceives his/her role in 
scliool decision-making and problem-solviAg activities, a's 
essential for reflecting community and family needs. This 
perception translates into observable -inpui into group ^ 
decision-makiog. or problem-solving processes during sehoo'l 
meetings . , ' ' 

• . Increases personal development throiKLh.. participation as- 
a decision-makafr and prpfalem-solver ^ Kie parent^ is aware 
that' ef f ectdveness Tili'grbup processes is ^baseji oh his/her 
ac4uired , abilities as a. competent decisiori-mdker or proble^l- 
solver. In recognition of' this contingency^ . the parent 
takes full 'advantage of trailing sessions, 6r other group. " 
meetings for the enhancement of these qualities, . . \ 

* _ * '» 

Teachet outcoraes : 

• Provides rj.ns truction ma,tching the child's develoymenta^l 
learning level , ^ ,Ther teacher pgrceives^ the adoption of a - 
(flevelopmental learnimg perspective as essential 'for pro- - ^ ♦ 
motiri<^ socioemotional , cognitive, -psychomotor and a&a-demic 
growth. This awajrferiess is operationalized through indi- 
.viduali"2ation of instruction, to match the child's learning 
level. The teacher demonstrates competenciea^n, assessing 
this learn i^g^T^evel "and maintaining current profiles of each^ 
child'^^'^'^ir^rning abilities, a ^ ^ 

C reates a classroom environment conducive -to the develop-" 
ment oT social competency . The teacher- perceives atten- _ 
dance at child development inservice €raining sessions 
or discussions as essential to learning how Jto create ^ 
an appropriate climate for nurturing social competency. 
The teacher then takes tangible' stejJs to create such a 
climate by adopting a warm, child-^directed interaction 
style, providing a balancfe^Detween 'child-initiated and ^ 
teacher-initiated activities, utilizing materials appro-' 
prdate for given developmental^ levels, encouraging curi- 
osity and discovery behaviors, and helfTing the child to ^ 
obtain skills, necessary for social pfoblem-solving pom- 
petencies. * , • * 

Acquires knQjj^ledge of *resources. available to meet needg 
of PDC children and , families ^ 'The* teacher is aware that 
to provide the bes^suppor^t services for c^ldren and fain- 
ilies, there must^Be a knowledge ^f availaOT^e community 
and< school district services as well as an awareness of 
possible roles parents might 'play Sis assisting agents,- . > 
This awarene.ss is r,e^lected through active participation 
in si^pport services training sessions wheye such p-nformation 
^may b^ obtained 4.and discussed. In addition; the teacher 



Requires skilly for interacting with ^^d instructing 
exceptional <^il<h^en* in the classroom.^* . 
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• Provides activities for "Bilingual/bicultural children . 
The teacher perceives an active participatory role in 
b^ilingual/bicultural inservice training sessions as in- 
c'reasing his/her awareness of the needs of bilingual/ 
bicultural children and families. This perception is 
manifested in- utilization' of multi-cultural materials, . 
relevant learning experiences knd assisting the bilingual/ 
bicultural child's adjustment into the mainstream of the 

. classroom and school. 

Staf f-as--a-<groiip outcomes : ^ • 

• Staff members interact with members of differing grade 
I'eyels . The teachers *as a group share a common recognition ' 
that adequate communication,' knowledge conderning the devel- 
opme-ntal nature of a child's learning experience-, - al^d a 
shared philosophy can only be obtained through interaction ^ 
with dach other. ^Teachers interact -across grade levels . • 
through discussions , obs^ervations in vaifioys cl^ssrcoms, 

^ or trading teaching assignments. 

sl^ff members jointly plan and develop educational and 
. ^ program goals for children, parents and themselve^s . The' 
' teachefs a-s a gro^ap perceive ^cobfierative planning efforts 
as necessary" for achievihg continuity in an educa.ticmal 
and support services-oriented program. This perception 
' results in attendance and participation in staff meetings . 
designated for curriculum materials selectiorj or articu- 
lation of program goals. - ^ 

• Staff members commonly gain competencies in group problem- 
solving -and decision-making techniques . The. teachers 

as ^ group possess a shared awareness regarding the necessity 
for a productive gr^up process of acquiryig effective group^ - 
problem-solving and"^decision-ma*ing skills This awarene^Ss 
is demonstrated by attendance at inservice training sessions 
, or small problem-solving discussions Where such skills;^ 
may be fostered and matured. 



Institutional Change outcomes ; * 

• Consistent staff , school and parent interaction . Teachers 
and parents commonly perceive that a shared PDC philosophy ^ 
• can ohly be implemented through consistent interaction • 
with one another. This perception becomes manifest during 
parent- or teacher—initiated conferences for. cooperatively 
, discussing^ a g^ven 'child's status 'in t^he classroom and 

home , joint, attendance at relevant training sessions , and . 
' joint participatidn • in school or PDC meetings and activ^LtiVs. 
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• United effort by teachers and parents in designing and 
deyeloping educational gqa.ls . Teachers and parents- alike 
recognize that a PDC program which reflects the needs' of , 
children and the community / the child's developmental level, 
continuous edOCatronal experiences, and enhancement t)f 
sj:x:ial competency ^can only be achieved through united 
pi^iUiing attempt5. This recognition is operationalized 
with teachers and parents at^tending, and. actively partici- 

'pating in p-Lanning-oriented committee meetings or goal- 
setting sessions. 

• Integration of Head Start and elementary school philosophies 
and services . Staff an^d parents perceive the integration^ , 
of^Head Start and elementary school, philosophies and- ser- 
vices as necessary ' fot promoting developmentally continuous 
educational and support services programs. This perception 
results in a shared 'PDC philosophy, the ^adoption of'ajcon- 
tinuous educational approach / continuous provision of s^r- * 
vices for children and families, as well as consistent , ^ ' 
parent involvement, continuing group planning efforts and ' ' 
adequate commiipication across grade levels and with parents. 
Bbth staff and parents possess clearer goals for themselves 

as individuals, and. as a group working cooperatively to 
achieve a developmejitally continuous program. Achieving^ 
th'es'e goa-ls i,s equally viewed as rewarding and -Satisfying 
by parents and staff. - ^ ^ . 

It should bo clearly recognized that many of thiese goals 
represent a radical . departure 'from long-establishfed school practice.^ 
To include parcnt3 in the process of educational decision-making 
is an innovative procedure. PDC is emphasizing tjie sensitization , 
of teachers to the sf)ecial needs of the lower socioeconomic, 
bilingual , and handicapped child, a process which requires in many 
cases the .development of innovative curricula and new classroop 
procedures. Another break with established tr^adition is the re- ^ 
quirement that Head §tart and elementary school teachers jointly 
plan a* coherent curriculum. To document the progress which the 
schools make ill implementing these chan^^es is, an important goal 
of the evaluaH:ion. . ^ , 

In the past teacher and staff support,, or the lack thereof, 
for innovative ^ducational programs originating from the , government 
has received insufficient attention from evaluators, despite its 
criticaj,' importance to the success of these programs. This evaluation 
is attempting to remedy this defect by the inclusion of measures 
which will address institutional -change in terms of adjustments 
in parent , v^^acher, and staff attitudes and interactions. 
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Selecting Measu^e^ for Assessing Impact 

A few studies have demonstrated the importance of assessing 
both attitudes and behavior, although the relationships *among 
them are far from straightforward. Stanford Research ^Institute ' s 
(1971) Head Start study found that a teacher's perception or 
attitude toward his/h^r program or sponsor was highl^i related 
to child gains on the Wide Ranger Achievement Test. ' Coughlan 
and Cooke (1974) found that in schools where s'ixth grade children 
obtained higher reading scores, teachers had more ^avormle 
'attitudes toward relationship's amonc^ teachers and. toward community 
re^at^ons, and had higher levels of job*satisf action Other ^ - 
studies (Klein, 1.9,73; Prescot-t and 'Jones, 1972) haye found similar 
attitude-outcome relationships. Findings such as these suggest 
that an evaluation of teacher outcomes, should also include 
measures of attitudes which may accompany specific behavior 
change * „ , ^ . . , 

Parent attitudes toward school and teachers may also be' 
important indicators of program functioning, but there hafe been^- 
iess research on these relationships. Xn their ,analy§is of . 
Follow Through data,.^b± Associates (Cline, 1974) investigated' 
the relationship between parents' views of school "^receptivity" 
and their degree of interaction with teachers ot participation 
.in school meetings. Their " analysis found no relationship - among 

thes'e variables. . 

* * • ' * ft 

Social psychologists have been studying organizatiQnal * . 
de^velopment for a number of years (Fountain-, 1975; 'Schmuck "and 
Miler, 1971; Schmuck , -Runkel , Saturen, Martell, and Derr, 1972). 
Since' many of the early findings v^ere disappointing (Nadler,# ' 
et al., 1974), recent efforts have been directed toward improving 
approaches for assessing organizational change. * For example, 
staff of the Survey Research Center of the University of ^Michigan 
have been developing models for measuring change in organizations 
(Robert Cooke and Philip Mirvis personal oommunication , 4975). 
Their work provides a' foundation for developing^ a comprehensive 
asSessmen^procedure for PDC. 




Ir^^Kreloping thes^ procec^Mres , several principles have befen 
-^uggest^^Hfc guide th^^feasurement and analysis jfbrocess . First, 
the mea^^PRnent prongs must be multi-level and ' multivariate ; a 
wide range of vari|«es dealing with individuals, groups ^nd the 
new entity linki^^i^^ead Start and elementaty^ school need to be 
assessed. SecofTd, multiple methods should be employed; the evalu- 
ation should include techniques for gathering data^ which use a 
variety of methbds (observations, archival records j and unob- 
trusive* measures) in addition to self-report instruments (ques- 
tionnaires, inventories^ and structured interviews). Third, it 
was decided to use a standard set of measures across all sites. 
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^ The multi-method appAoach adopted in this evaluation is " ^ 
expected to genferato' dita allowing statements which will go 
beyond simple descriptions .of outcomec and\_include reasons for 
the outcomes. This requires an analysis o£ the 'relationships _ 
among a variety of variables: program inputs, perceptions , 
attitudes, and behavior. Figure 7 presents one "model" for 
conceptualizing the interplay of factors important in the change 
ppocess, AS the reasons for program effects are understood 
more fully, the evalu^taon will be able to provide more useful 
information for program planners and 3e?ris ion-makers to guide 
the .development -of future* programs. 

In ^addition to facilitating the understanding of these re- 
lartionships , the assessment of a variety of outcomes garovj-des 
stronger evidence of program effectiveness. According to some Of 
the researc)! in organizational change, changes in attitudes and 
feelings of ihdividuals ar^ indicative of a more- durable prograun* 
effect. One might argue that behavioral changes alone (e^., 
parent involvement in the classroom) may be shortlived if the 
parent's feelings about the prograitl are not affected. On the other 
hand, a change in attitude:, (e^g^. , parents say they^ ^^e pro- v 

gram) *might be l^ss valued if it is "not accompanied by' outward 
manifestations of the improved attitude. * * 

^ • . 

Summary of Measurement Procedures ' „ " ' 

.- - 

i \ The expected outcomes in terms of the beh^v^ior of parents, 
teachers, and, staff are listed in Figure 8; Figure 9 listsnout- 
comes- in terms of attitudes and perc^tions. Beside each outcojjje ' ^ 
is a list of data collection methods that will be. employed. -The'^ / 
case studies are already dealing with some of these outcomes through 
the use of structi^ed interviews , (one of the self-report methods) 
and the examination cif archival, records such as minutes>of com- 
mittee meetings. The primary purpose in this section of the report 
is to recommend additional self-report measures that will ^i^pplement 
the other procedures an3t which focus on the attitudes ' and per^ 
oeptions of program participants. Among those- instruments -that 
have been examined, three have been found which contain items or 
scales appropriate for fissessing the impact of PDC: 

• ^ Michigan Assessment of Organizations ' (Nad'ler ^ et al.', 19,74).- 
During the past two years this instrument^ has been developed 
for tb4^d party, assessment of change in organizations. "It 
has been used in a variety of industrial, service and edu-* 
cational settings. Xhe MAO offers cl^ool of questionnaire 
scales and items^ for measuring individual rol# perceptions, ~ 
goal clarity and feedback, climate, group proces^B^ and 
effectiveness, and individual differences. \ . - ^ ' 
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Experienced 
Stimuli 



Perceptions of 
School, Staff 
and Parents 



Perception 
of Program 



Individual 
Differences 



Individual 
Differences 



options of 
School St^ff , 
Teachers and 
Parents 



Perception of 
Program . 



Figure 7 
Model for Viewing PDC In^sact 



Reward - 
Contingencies 

<■ — 



Parent and Teacher 
* Outcome^ 




Anticipated 
Elewards 
ontingent on 
Dutcomes 



Anticipated 
Rewards • 
C<5ntingent on 

WorHiASr 
Together 
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^iticipated 
<TOwards 

Contingent on 

Outcomes 
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Institutional 
Outcomes 



Participation in School 
and Classroom Acti- 
vities ^ 

Demonstrates .Under- 
standing of Child , 
Developmental Levfel 

Provides Input into 
Decision-Making and 
Problem-Solving Acti- 
vities ^ 

Increasing Personal 
Development 



P^o^ides Individualized 
Instruction 

Creates ClaissTOom 
Environment ■ 



-^Acquires Knowledge of 
Resources , 

Provides Activities for 
BLyfiC Children' 



^ta ff Me mber s Interac t 
Staff Members Plan 
Jointly 

Staff Member^ Gain 




Consistent Staff, 
School, and Parent 
Interaction 

United 'Effort 

Integration of Head 
Start and Elementary 
School 
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Types of Assessment l>rocedurfes for Measuring Impact on Parents, 
' ' Teachers, Staff, and Institutional Change 



PDC PROGRftM OlrrCOMES 
Parent O utcomes ' 

Participation in school and classroom activities / 



Demonst;:ates understanding of a child's developipental 
educational process" 

Provides input into school decision-makiag and problem- 
solving activities 



.|(ers( 



Increases. personal development through participation 
as a decision-maker and problem-solver ^ 



• ASSESSMENT PROCEDURES 



Archival sources 
^ Self report 
Observation 

Self report? 

ODservation , 
. ^ Se^f report 
.Archival sources^-. 

Self report 
Archival souses 



Teacher Outcomes 

Provides instruction matching child's developmental 

learning level ' ^ . 

/ 

Jtr ^ 

<:reates classroom environment conducive to* development 
of social competency 

Increases personal development through participation 
as a decision-maker and problem- solver v , 

Provides activities »f6r bilingual/bj-cultural children 



Observation 
Archival' sources ^ 
Unobtrusive measmres 

Observation 



-Self report 
Archival* sources 

Observation ' 
Unobtrusive measures 



Staff-as-a-Group Outcqj^s * . ^ 

St^ff members interact with members of differing grade 
levels ^ ^ 

Staff members plan and develop jointly educational and 
program goals for children, parents .and themselves 

Staff members commonly^ ga^n GOit5)etencies in group 
problem-solving and decision\making techniques 



Self .report 
Unobtr\asive measures 

Archival spurces ^ 
Self rfeport 

Archival sources 
Self re^rt 



institutional Change Outcomes 
Consistent staff and parent interaction 



United effort by teachers and parents in designing' and 
developing educational goais 



of Head S tlcif*^.^ndj^leinentary school phil- 




es and services 
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Archival s^urces^ ^ 
Self Report 
CSafeervation 

Archival scTtrrces 
Self report 
Observation 

Self report , 
Archival sources 
CA>servation 
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• Figure 9 ^ 

Instruments for Assessing Perceptions and Attitudes 



^pCEPTIONS AND ATTITUDES 
Par eats * , , 



Perception of program 



'Perception of school 



INSTRUMENT 



85 



Interviewi 

Attitude ^JBstionnaire- 



Attitude Questionnaire 



Perception of reward contingencies related to' 
behavior outcomes 



S^aff and Teachers 

Perception^, of school,* staff , teacher and^ 
parejfts 



^rception prog^fcim 



Attitude Questionnaire 



Attitiide Questionnaire 



==Attitude Questionnaire 
Interview * 



Perception of reward contingencies related to 
behavioral outcomes ^ . , 



Attitude Questjfonjjaire^ 

V 



if 
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The. School Survey (Coughlan, 1966); Th€ Survey, used- 
more than 100 -el^entary and secondary schools, consists^ 
of»'l20 stat^ents (to whdch- the respondent agrees o^|^d>^^J 




vation, and educational effectiveness.' ^ The scales w*e 
found to discrimina'te between high and loW performance 
^sohool^ and to have good reliabfLity (Coughlan and CoqKe,' 
1974).. Scales ancl iteius most relevant to- PDC include 
Idministrativ^ practices, professional and no^i-proT essional' 
w6rk.load„ educational effectiveness, sehool-communil^ 

relations, voice in educational 

relations. ^ ; " ; 



relations, colleague 
p r ogV^fi , a nd su'pe r v i so r y 




e. Educational^Porces^ Jnventory (Rayder and^ody, 1975a, 
'This inventory allows the' evaluator tcf'^'chart" the _ 
ous forces in 1:he* teacher ' s' social-psychologic^^field. 
teacher or other staff person is asked to rate^ie 
ree of influence l3 forces ^exert'' in the classroonTprocess 
tRe degree to which this, influence is negative or 
. positive. It hasAbeen 'Used in a Follow Through evaluation^ « 
and possesses' good validity (correlated with a mea.s.ure of " \ 
teacher morale) and internal consist>ency . If expande(? 
for coordinators* and administrators/ use, this inventory 
could assess th'^^erceptions of influertpes fi*om several 
perspectives. . 

Sets of- items or factors will be selected £T6m th-ese in- ^ 
u<nen£s to develop a PDC Teacher Survey.* A Parent $u^vey ^ ^ " 
1 also b'e constructed to assess outcomes -for pajrents^. 



^2 



\ 
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' ' Bilingual/Bicultural Measures 



I 



' One o-f the cbrnerstones of Project Develojpmental Continuity 
is the recognition of individual • differences , rbt only-in relation 
to children, but filsjD, on broader level, rn relation to sites. 
All, -of the Sites have unique characteristics, "but four sites are ^ 
dist:^^€fuished by the designation, "Bilingual/Bicultural DemonN^ 

strat-ioHr-Site. " ' This mean^s- that tiiese is it es ^are~e7cpect^d tx> ^ 

pravide a bilingual/bicultural educational approach, which is 
described ^in' the PDC Guidelines as using the child's native 
language for instructional purposes to "reinforcil the child's 
positive self -concept by 'validating his culture." 

•The four' i)ilingua'l'/bi.cult:ural demonstrati-bn sites have a * 
subs^ntial number of bilingual Children, , those whos^ Vuse 
and comprehension the English language aife limited, arid 
who spe5k a lartguag| other* than English at home" (OCD^ Guide- * ^ 
lihes, 1974). the four sitefe vary in degree of bilingualism ^. ^ ' . 
from^9% Spanish-speaking children 'in pne Head^ Start center 
in Co-Jrorado^ to 100% Nav^ jo-speaking -children in. Arizona. 
(S^e^ral other, sites, not designa^^d^as demcJnstration pi:bgraWs,; , 
also have a sizeable p^rcentaf^e of bilingucil' children. 

/• ^ ^ ; / ^ / ^ . . ^ , ^ ' ) 

Xhis empKa^is on the recognition of the uniquenes-s of biXin- 
gual children is 'ifnpoptant; because of the growJing awareness of 
the essential link between a"*^child's language ^nd his/her 
identity, and because of the negative outcomes -associated with' 
denlgr^tring an^i^tegral part pf a child self -concept (United ' " 
States Coiftmission on Civil Rights, 1975).. As Arturo Gutierrez 
states, "*If a child is dominant in Spa^is^h, the use (or lack »of 
use) of that language for j.nstructicJn , the teacher's attitude . ' 
toward the use of ' the languag^ , the teagher's acceptance, or 
^rejection bf the lajiQuage , ^values; total Cultural make'-up of ' 
the child, cc^lild haVe serious , negative ef-fect's -on the child's 
perscyialitY — his s5lf -poncapt , confidence-, his perjjreption^, etc*" 
(Raizen and BObrow; 1974b),. The PDC Guidelin'es reflect this ' ^ * 
concern dfid insist tha*t "the ptogram must enrich and 3Bxpahd upon 
the strength^U^tjhat the chijdren bring to^a new learning situ- 
4tio|ji and ribt follow ^ coinpensatory-def icit model 'The native 
language and^ cuiture of the children will be regarded as aiv ' . \* * 
ass^t * . " ' ^ ...» ' ' . _ " 



This recognition of the value of i'haivj^dual differences 
affirms a relatively recent general interest in preserving cul- 
tural uniqueness,, and ref lects^^^cial scientis.t^^ historians' , 
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' and educators' turning away^ from the traditronal- esteeifi ,in which 
* most h-ad.hGld the "melMag po£" J^heory in favor of pri^ing-'cul- 
, tural hetorogoneity (Highafn,/l975 ^ Wacker , 1975')-. It is nat ^ 
' enough ^however,' to affirm cultural, uniqueness if the^variety 
,tHat exists- within the cultures is- not reco^nized^. A major 
' theme ' running- throughout tHe reaction pap^s of Rand,' s^ Spanish- 
surnamed' p^helists is the- danger of^ assuming that ^there is ^^-uch 
^ a thin(3 as a <^^olithic Hispanic culture (Raizen and' Bobrow, - - * 
„19*V4b) . In fa^t there exist/eignif ican.t v^ariations — regional, / 
rural/urban, SES; historical^ linguistic, and count:ry-of rorigin 
/variations — ^all but thW latter of which are relevant to the' 
^ '"three SpanisM biling^ualTTDAriittufal sites . Th^^'^tTartf orhia ^DC - 
' site'is.an agriculturally based town i with most Mexican-American, 
-"Children being* seco'nd and third g^peratio-n; tljie'i'exas site is a * 
small border ,town with many first-generation, monolingual Spanish ^ 
children; ai;id 'the Coloi»ado site is> an* industrial *city withj pre- 
dominantly monoli*ngual (English-gpeakingT Mexican-Ameriican families 
.who have resided^ the^e for nfany generations, •.The fourth bilingual/ 
• bicultural rsite, in Ariznna, i6^ a low population-density, 
! area 'where most .FJead- S'i^art children are ' monolingual in Navajo>\^^^ 
Obviously these 'individual BL/BC denibastration s';^es have unique^ 
I characteristics .wjiich place special con^.traihts on test selection 
and interpretation, ' , ^ / ^ , * ^ 

. r • ^ ^ \ ' • ♦ • 

The other .fundamental t^net of *this projec^t is the reduction 
of discontinuity in ^the -child ' s experience not" only between K^^^' 
Start and .the elementary * schools , but also between home and 

- school ,^nd, in the case tjf bilingual chl.ldren, this requires 
bilingual education. ^'Bilingual/bicultur^l education- is designed - 
to help the cjxild m,ake the transition from home tb School more 

~ eas ily try remic ing the ,d inferences t»etween~thi^ Idiiyaage and" ~ — 
culture of the home and that Qf the school" (United vStates 
Commission on Civil Rights, 1975) * * - ' • 



\ 

I' 



Def inin9» Bilingual/Bicul tural' Measure^ment Areas ^' 

All of the'prdt^Ieins encountered • in selecting >pp:^o|>riate 
measures for English-speaking preschool children werfe exacerbated 
in the attempt, to f ind- mefasure^ appropriate for S^nish-speaking , 
miked-r&nquage or "Spanglish"-speaking children, and Nava jo- 
speaking CTiildren. As part of the PDC measurement design, the 
BL/BC sites were to receive bilingual adaptations of the baSiC 
battery for all sites as -well. as site-specif ic jDilingual measures. 

In appreciation of the facjt tha^ testing bilingual/bicultUf al'* 
children presented many complex i^s^ues, se<^eral sources were, 
consulted. First, vitf^ serious considlerjation was given to the 
reaction papers of the Spanish-surnamed panelists of the Rand^-^ 
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Corporation to^ its report on evaluatihg^sbcial competence (1974b) . 
Second,^ the United States Civil Right^ Commission report,, , 
A * Better *C?hanoe to Learn; Bilingual-Bi(4ijJ.t,ural Education (jL97 51 
•'was examined, and finally,^ 'recognized 'ejqierts in^^the^ ^ ield of • 
bilingual researclj were consulted. A summar^y ^Of th^ main issues** 
l^hlch 'those sources delineatecJ^and which were VeleVant* to PDC 
is presented b'ecause they form the basis *for selec*tijig, modi^fying, 
admmisterijiq^^nd interpreting any ins.tjrumeivts to ^be used_^with 
bilingual and/or Hispanic children. ^ ' - • . 

One' of th^^ost important coi^slderations which stands out 
^ when^Ti evaluation" "of, bilingual/bic.ultural children ts" conduc'te^ ^~ 
ds the nece&^ity fpr specifying the social dojnains for patterns 
of languajj|e use.*' This *pqri>t was emphas*ifed by* Lui^. Laosa in a 
* paper describing some varying patterns'of ^^anguage ° usne. in *diff err 
en^ social domains among .^Mlfferer^t Hispanic .groups* "Social 
domain" is defined as ^'ntajor spheres of act;ivity\in a cQlture, 
such as family/ education, i^ecreation" (Laosa, 1975). * Again 
the inaccuracy Of the assumption that a monolithic culture exists 
was made. clear. . \ 

%v ,^ • . . . ' \ r\ 

point was also mad'e by, Slobijiv who stressed the . need for 
linguists to ascertain the relatiio^ .between ^ social .milieti and 
•the devetojgmpnt' of * language competerice, bfeiause^the' effect of th^ 
. fafnily on language socialization practices was d'le^rly signifi- * 
cant but ^^a|i -hi^thetto _]^en neglected (1967). He admitted thaj;,^ 
lin(juists knew^ very little '^afb^uFt::vck4i,dr comget;ence in th*e 

use of langv^agev hoW they learned, 'Wherl to'speaV crn^'Vhen to. remariri 
sil^ent, with whom to%ase .slan-g and^ with whom not to> and when 
to/ shift '^an^a^es in ^ multilingual ^ Community . \ ' , 

\ Laosa's research ^ddress^ed .this issue of the social contSkt - 
f inoj:hei;-tongue Maintenance, ^in whiph a stabl'e bilingualism* v ' > 
persists, versus the context of ^languajge shift,, in which^the * ^* 
separate domains of languages vani^sh^ and the speaker -uses bpth 
]^anguaiges, vrAthi.n one* sentence. He found that- tjier^ w^re signifi-. • 
cant> "su-bcultiiral variations in language pattern^ -^in different 
social dOmaiTis between Puelrto' Rj,tan§,'in the Brpnx', Cubans p^n . / ' 
Miami/ and- Mexic^ah-Ame'^icans "in j^*ustin f Texas.' 'for exampLfe \ 
Mexican-Amef ic^n children in Austin we^re expQse& to signif icaritly,^ 
more ITnglish and "^P^anglish" (lanauage mixihg within the same 
sentence) in ^h^- hdme 'and sppJ^^f aCc. jnore English in spontaneous 
peer interactions ih school than either the' Curban American or 
Puerto^Rican children. In a border town lih'e the, Texas sit^, hdweve 
the- pattern of. language use of Mexican -Altiericarfs might be quite 
different because of contig&ity with Mexico.' Ife is concluded,- 
therefore, that data on the family and Isocial ecology fnust 'be" 
collected' and utilized in any evaluation of^ bilingual/bicul tural 
child-ren. • ' . . ' ^ ) ' 




The^ spec-if icatidt} of language Usage in the sociai^cJomain is , 
important:, algo because thej/e is .evidence that a" well-developed 
language' system app'ropi^iate for each domain may 6xist^(Cruz, in 
Raizen and.Bobrow, 1974b) t an^i therefore, many t,ests ii)\ Spanish 
'are inappropriate for .the Hispanic child if the' 'child , formal 
education has taken place iti English (Carrow, in Raizen, and , 
'^Bobrow; 197 4U) , if^-i-t has-been normed on^CubaTi or Puerta Ri<2^n 
chili^erj (Cruz/'in Raizen and Bobrqw , ^ 1 974b) - L'ao^a also^made"^ • 
the ^It met ion b9tween language deminance apd lahguage use, 
A*' child may actually use Spi^ish^ more,' especially in' the non-sahool 
dom^;n,. but be ''dominant" '(i.e^\ more litepate-) 'ih English,- ^ 

« To address cthis issud of specifying'' lan'^imge dbpiinance and 
social domain Gutierrez recommendefi -the follo'Ang (Raizen, and 
Bobrow., l'9L74b) : * ' . ^ • ' ^ ^ 

' ' , f DeteriTiine the. language and cultural dpmin^incfe initially 
of all children -in the child \€ classroom—Bernal^ 
recommended 'using langua'ge .ddminanoe as a'covariate 
' (Raizen and Bobrow, 1974b)'; "j " . 2 

. ' ^\ r 

• Determine the length of ^tiipe that one or hoth languages 
^re used during the day (and, presumably , in' which contexts); 

Detexmine the teacher's emphasis, eith^i: on Spailish or 
English language development, sodial -emotional development 
^ . or other a^-els; * . ' ^ I ^ > 

# Deterijiine .what kind ;of struotured language program, if • 

any, has been implemented. ^ ^* 

----- - .^r » . _ ' . ^ %. _ * _ - - 

Another *m'ajor concern of some of Rand's Spanish-surnamed 
panelists related to t^he specific language program implemented in 
the classroom,' Goj^zalez took the ,p054:t ion that the maintenance 
' of the child's first language, assuming tKat it was Spanish, was 
'^-^ primary importance for the ^cial competence orf Spanish-Speaking 
chlldxen in tlje bjirrio, A maintenance afpproach is al^o con^ 
sist^ent .with the recyirements ' that,^ bilingual/bicultural proSframs • 
reduce the discohtimaity between home and^ school and , encouragfe 
• the. child's positiNxSkaelf-cOncept. It might .also be expected to 
maintain, the child's respect for his. parents. , * * 

\The problem of determining juBt what cortstitu-tes a positive ^ 
self -cojicept in each' cultural conmiunity 'was ^ r^ii^ed by' Cruz . This 
is a concern' of dee® • consequence to PDC and 'is expected r.Oj be*, ' : . ^ 
addressed through t* use of .indigenous examiners who will a^lso^be- 
' asked .to serve as cc^^lt.awf n-^n many aspects of * the testing. 
This 'broader use of ^e indigenous .^aminers wa^ s\iggested by / 
Luis Laosa who recpmmendea the following: ^ 
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Indigenous examiners should examine the instructions and 
items on each of the instruments in order to substitute 
phrases reflecting - the regional' c^ialect where "standard" 
Spanish might be inapptopriat^ef. - ^• 

Regional modifications should 'be standardized within 
each area in advance for us'^on bctii pre-- and post-bests. 

Objectrs o/r toys f^amiliar to x:hildr-.en'in that locale should 

be^..»tibsti:tuted for those that are unfamiliar. . 

.f - • \ 

iigenous examiners should be used to interpret the 
scores, .to place^ them in the specif ic .cultural . context . ^ 

^ • Ind!ige'n/3us examiners should* provide information as ^ the 
• ^ local ^^^^^^^^ patterns according to social domain. 

^ The is sbi'es'' fair's ed by the Spanish-^sujnamed panelists to * the 
Rand Corporatiori, by "the Civil Rights Commission, and* by Dr. Laoaa 
formed the' bdsis for the evaluation both of the national battery 
and of site-specific instruments. The search for site-specific ^ 
mea^u^es was' made difficult by the facf- that- only experimental 
v^rsipps,of tests exju^ in' Navajo, and the fact'that very few 
SpanisTi--- language tests exist for pr.eschool chl'ldren. 

' % ^ . / . 

^he Head Start Collection 'report: .on tests for Spani sfl^speaking 

children (JRosen, 1971) yielded oji-ly two tests in "Spanish for _ , • 
pr.eschool children, h^ither of which w^s coi^s^^ere'd appropriate 
fox PDC gcial^; onq, becayse 'it required two days of testing a^id 
was pnly.in /^xperiTotental £orm (Inter-American Series--Manuel , 1966), 
tli'e other , because it was primarily a cognitive" battery , (Walker 
Readiness Test: for Dis3dvantag.ecJ Preschool Cl>rl4ren — Walker; no 
date). '^he Thorpe ''Develo^^mental Inve'ntory .(Thoppe ^ 1972), a * 
'developmental' screenirrg- procedure , was also ^examined , but'^tbe 
McCarthy Sc3^1es o f ^Children ' s Abilities ha^ several advantages 
.compared ywi1;h 'the^ Thorpe flTven though the Thorpe ha^ been used wi-th 
Spanisj)/s^eaking childre^ih California."' The Van 'Mstyne Picture 
Vocabulary ^est reviewed^by Crur (Raizen and Bobrqw, 1974b) , 
appeared to be "reliable and valid for* the measurement 6f tnental 
ability of ci^l^urally disadv antaged .MexiCan-American 6-year-olds V 

n^5«w:ia'l competence amd not -simpiy on. 
the deci'sion not* to;^recomniend that instru*- 
pltopriate for 4 -year -olds ('see ratings in 



but the emphasis o^, P 
cognitive abi'lity 1 
meht, even if it' we 
Table 5) . ' ' 




Recommended Measures * * . ^ ' 

— ^ — ' — • \ ' • . . " J ' 

' -One instrument appeared td Ue relevant to the pahelists*^ 
recommendation to , measure language ' dominance . (the Bi'lihgual Syntax 
Measure — -^Burt, Dulay, ^anSi Her-nandez / J^.fS). the BSM is designed 
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^ Ratings of Measures for Spanish-Speaking^ Children o: 
Criteria for Measures Selection 



s 

, ^ ■ ■ ; . " 

fO * 

Measure 


*^ • 

Practical Considerations 


Psychom^ric Qualities 


Relevance to PDC 


Past 

Use 


Available for use by fall 
1^75 


/^propriate for trained 
paraprofessionals 


Test format appropriate for 
PDC -age group 


Scoring procedures appro- ^ 
priate'for data processing 


, , 

Reasonable testing time for 
young children 


Adequate construct and/or 
< predictive validity 


Adequate test stabijlity and 
internal consistency ^ 


Culture and/or SES fai^r 


Representativeness of 
standardization san^ple 


<s ' 

Low correlation with index 
of general information 


Spans age range of |PDC 
population (4-8) ^ 


1 Spanish adaptation avail- 
able 


Relevant to PDC 
Biliftgual/Biculturai goals 


Ji 

? ' 


Used in previous national 
evaluation or Igrge-scalev 
studies 


*Walker Readiness Test for 
Dij^advantaaed Preschool O^iic 


ren 


X 


X 


















X 








X. ! * ' ' . * 

*Int^^r%taiericah Series 




X 


X 


















\ 

X 








Thorpe^-.DevelopmeAtal' . 
JnventoiTy,^ 




X 


X 


X 4 


7t — 






X 


' X 








X 




X 


*Van Alstynfr- Picture , 
Vocabulary ' ie St . ' 
































Bilinqual Syntax *Me id ure , 


X 


X 


X. 


x4 


f 

X 


• 










X 


X ^ 


^ X 


• 





♦Technical' manual has^ot^et b6en reviwod^ 



to mea-sure childrea's oral proficiency in English and/or Spanish 
grarnmatical structures by using natural speech as a basi^ for' 
nwking judgments. It encourages children^o express their 
thoughts and opinions freely, and is designed primarily for chil- 
'dren'who are between the ages of 4"^ and 9.' To 'elicit natural 
speech,, simple questions '^r^ used with c^toon-type pictures to 
provide the framework for -a conversation with the child. An 
analysis of the child's speech in answering these questions 
yields a numerical indicator and a^ qualitative description of 
the child ' s structural language proficiency. - 

^ Tt is~recominen^^d~tTiat"*I5bth Spanish an'd" EnglTsli forms^ of tiTe' ^ 
Bilingual Syntax Measure be administjfr^d to all children in the 
bilingual/bicultural sites., giyiag one form first to h^lf of the 
children, and t?ie other form first to the other half of the 
children, to obtain a measure of language dominance. It can also 
be used to measure the degree of maintenance or 16ss of certain 
basic Spanish grammatical structures in children^who acquired 
Spanrsh as a first language. 

Bil ingual/bicultura^l education should also have a direct 
impact on classroom ' interactions experienced j^y teacher^ and 
children. Luis Laosa (personal communication, 1975) suggested 
that several categories could be added to the classroom obser- 
vation system. The , following dimensions will be developed into 
observational categories or ratings: ^ » ^ 

•H^T^acher's use of her aide/ i.e., the role of bilingual aides 

• Relative frequency with which the two languages are . . 
actually used' in the classroom and which languag^'is ^ ^ - 

-spoken during different social interactions; 

• Type of bilingual Education mod^l being used;- 

• Kinds of behaviors teachers reward and relative amount 
of teacher attention 'given to- Spanish- and English- 
speaking children. 

Adapting- the Basic Battery for Bjlingual/Blcultural Sites 

Al L of the instruments recomiT\ended for the basic battery are 
currently being translated or adapted into"^ Spanish . ^ A* incjicated v 
above, each af the -measures yn the^basic battery will be careful^^y 
examined by the indigenous exartiin^rs to, determine if the Spanish 
translations of the instructions are clear and if the items are 
appropriate to their region. 



The observation instrument will include items on~'language^ 
pattern usage at school, and specific teacher-child interactions 
'^and teacher-aide interactions pertinent to language usatge will 
, be included. Again, the indigAious examiner s^i^e expected to^e 
utilized in the interpretation of scores in the^light of specifi 
cultural expectations. 



Measures for 51ite"5rpecific. Batteries 



The ^original design for the PDC evaluation recognized the 
fact that there v/ould likely be many differ-ences among programs 
implemented in 15 sites across the country. To allow for differ- 
ences in site characteristics and in goals and objectives of 
individual programs, the. evaluation design specified that^ in 
addition to a })asrLc battery^ to assess impac t ac ross all sites^ 
site-speeific batteries be employed to assess impact within pro- 
grams. This section of the report presents the recoramendations 
,for measures to be used in site^specif icr batteries after 
reviewing the various issjues that were taken into consideration 
in developing these recommendations'. 



Issues in the Development of Site-Spe cific Batteri-es 

^ * 

^There are several issues related to the use of site-specific 
batteries in the evaluation of a national demonstration project. 
These are briefly discussed before presenting the recommendations 
for the batteries^r . . - ' ^ / 

Fir;st, the nature of the basic experimental design and the 
analyses that accompany that design* is involved.. If* substantial 
differences among sites exist- in the outcome measures /tthe covar- 
iatasy or in the correlations betweep covariates and outcome 
measures, then generalizations about the "national" prograip may 
be unwarranted. V/hen this is the cas6, there is the option of 
treating the study as multiple site-specific studies or -limiting 
the analyses to within-site , analyses. This, of .course, does!' not 
roatiiro different sets of measures for each site, but to the 
extent that site differences demand site-specific analyses, th^ 
study .would be further strengthened by having 'measures that'^are 
partlc^arly suited to the individual sites. 

Built into the "plan for the *PDC evaluation is the pilot 
year of. testing (1975-76). Given this fleifibility it may be 
possible to cdnsider using some site-specif iic measiures not ortly 
'to determine wliether tMey a're adequate for that particuXair site, 
but also to see whether they would be suitable measures, for use 
in^a number of sites or for 'incision in the basic battery used, 
across all ^ites. This is not a sufficient justification f or 
expending resources to develop site-specific measures, but is a 
use that should be kept in mind v;hen si1!ie-specif ic measures 'are 
being, recommenced. ^ , ' 

Natidna}: policy'-issuds also seem related ±0 the use of , sit^- 
specific batteries. ^On the national level therC presumably are , 



concerns about the feasibility of a program with the features of. 
Developmental Continuity. One concern might be whether the game 
(or essentially the samej program can be successfully implenented 
across l^he country regardless of local conditions or whether the- 
program must be carefully tai;.'ored to individual sites' needs in 
order to be successful. Local successes maS^, very well be obscured 
if the evaluation is" -limited tQ a national battery designed for the 
'"averaye"^ site but fess siiited to "any particular site. 
- - , . . . , ' 

Program Goals ^ - , 

sic rationale for 'including in the CLvaluation measures ^ 
that arc unique tio sone sit.os is to enable the assessment of goals 
that are unique to those sites. The progr^ responses to the * ^ , 
cK>als (tu(i;stionnaire., which have been discussed in connection, with 
the tasirt'batter.y, have p^rovlded some infotmation about the 
uniq/ieness gf lo6al goals. The information is somewhat difficult ^ . 
to interpret, however. Of the, 25 goals for child competence * 
and for ])arent;s and staff, there were very few on which a majority • 
of the sites agreed. This is in part due t^o the questionnaire s 
response format which asked programs to indicate the five ^oals for 
children and the five for parents and^ staSf cj<?nsl(3ered "most 
important" for their program. -4 But since the^goa^s listed on the 
questionfSlire were selected bechus*they sqenecj to relate to^ PDC 
goals or to export opinion ^regarding desirable program outcomes, 
everwthe ones^ not selected as "most^ important" night be expected 
to be, valued' by the pr^^grans. Thus, in developing the basic 
flattery tcr^^o used apross all' sites, unanimity was not required -.^ 
when judging a goal as relevant for the national battery /(see 
Figures 4 and 5). U'hen ' responses to* the goals (luestiomiaire 
v;ere ?^xa^ined with the si-te-specific battery In mind, there W^re • 
only a few goals that wore found to be uniquely^ hold by a small 
jiumber of sites. T'he following child goals, for example, were 
identified as "most ifnpdrtant%by btily one or two programs 
(of the 11 responding)*:" . ^ / ^-g^ " 

m Gro^s motor skills • . ' 

, ' • Perceptual skills 

Perceptual mo.t?or skills ^ . * ^ 

• Auditory skills > ^ 

• Flexibility in the 'applica£ioai of information processings , 
'Strategies ^ * * * ' - , 

' • Hchqol readiness " ^ . 

m Aural cdmprehension-' / ' ^ » ^ 
, Productive '(language) competenC4& • ^ a 

Half of • these are^in the p^ychorptor area and half "in'the cognitive 
and language domain. The >psychroVjptor goals, except for aAiditory 
skills,^ arc being assessed as part of the basic " battery because 
of, the desire to havd a battery thlfc vtes . responsive' to the total' ^ 
ranq'b of social competenc^^ Of the* four cognitive and language 




qoals, aural pomprehension is related to the yerhal memory task 
recommended as part of the^basic battery (see Table 4).^ Thus,, on 
the basis of responses to the goals .questionnaire, there are three 
areas identified by individual programs as be^ng important that., 
would he candidates for ''assessment \^ith site-specific measures: 

• Flexibility in the application of i'nf drmation. 
processing strategies ^ • , - ' :_ • 

• School readiness . ' ' J 
Productive language competence 



The selection of measures relarted to these goals will 'be^discussed 
below. • * ' ^ ^ ^ 

■ There^ were also several goals'' for parents an5 staff that 
^ v^re uniquely.- he Td by a f ew progy aras^; ^ However /' all' these goals 
are considered important in terms of national PDC "guidelines , so 
it is Recommended tliat they be ass€?ssed across all sites ^ven if 
not considerdW, particularly itnpoatant by the local prodram (see 
Fiqure 3) . ^ 



c 



Reduce^d Importance of Site-Specific Batterj-es 

Five factors have served to diminish the importance_of 'having ♦ 
a complex set ^of site-specific measures. First, it has been 
feasible to recommend^'a fairly comprehensive basic battery^that 
. appeaf-s to address the cQncerns <|)f a sizeable pro]|prtj.on' of tt^' 

* sites. > Second, the information , on site-specific goals obtained 
from the goals questionnaire sugges^^ that ^ere are relatively 
few goals that are unique to one .or two prog]^ms. Third, the 

. bilingual/bicultural measures recommended in th^ preceding section - 
of this report stlccessf ully address a large portion of the site- - 
specific objectives a,nd concerns. of the bilingual/bicultural 
demonstration programs. A fourth factor is that at the elementct^y 
level, wherie the effects of continuity ^re first minifested,^ all 
schpo;L sy^stem-s conduct their own testing programs. It is possibl^ 
(thougti not always the c^se) that thgse tests* will be relevant tc 
■ PDC goals, and that data from then can be incorporated into s4te- 
' specific evaluations. Finally, one of tl^e purposes of site- ' • 
-specific meaj^res >can -be accomplished in the analysis*^ and iji^terpre- 
tation of findings froi? theSbasic battery. Local programs can 
be given the oppor^tunity to Yncjicate particular tests, subtests ; 
. of evea- indx\>idual items yhikh they juHge as assessing goals that 
are particula«;ly important tto their program. .These can then be 
treated in the analysis/as 'isite-specif ic measur^^" for the ' 
purpose of making judgments ion the effectiveness of prog;i'ams in - 
^ terms bf their own goals. This would be a valuable procedure for i 

* another* reason. Decisions about measures to be bs'ed have been_ 
• bafted dn judgments of the releVance of the measures to variotis 

goal statements (a^S, for example, listed In. the goals questionnaire). 
Since the goal statements are not opferationalized, they are Open 
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ttsi dif f oront intnrprotati^pns and -even ^.though tvvo programs mjiy^, . ; 
ap^^ar to'amree o^t a ^|oal, thCy .my in fact hcfve different 
6bit}ctive>>. v^V/hen .progran . n^af f have' aA opportunity to, examine J • 
spe'cific .itenr, amd ^tc^sts th^y ^/^ll'be la a better position^ to 
judge the relevance of the measure to the'ir program. . ^ 

\ Mthougfi for.tlto purpose^.of this, report; recommgndationp " 
for Gite-r>|^ecif ic' measures Been less Import an t"" thar|^p£Svl^^ 
it sl^Ald ])e made qlea^r ' that -th^e ccmc4u^^on' is not intended 
to^i^Riish' the inpQrtanpe 9f*'^drf f erences in site chaisEicteristj.cs 
arif^[go*air, . The need to prpvidg an evaluat:ibn i^tocess 'that is*' 
responsive to lo^al ^concerns is stj.ll pcoramount and will be 
addressed in tlie w.ays discxi^.sed .^bovo.. ' ^ - 

Rocomnended rieasures for ^te-Specific GoalS " 
• ' — — — — ^ : — = — ' * 

^ In Mglit of 'tff^^ "al)OV^ cons^deratidins ; a ^Joinprehensive set 
of m^asuresto assess potential site-specif i<^ fconcerns does , not-- ^ 
e» sep^ v/arra/J!|^d: \r.athe5:, rocomnjencJatl©n^ V7ill.%be -mad^ for measu^-^ 
me'ht in key'^afe^/V the f ina£"&election will, howevet*, be 'at the 
,^ opti'on of .the sl|es» The. areas 'ar^«: . » ^ 4if^ ^ 



• a/"^* •^>cficol ftadiness" ' . . -v * ^ , ^ 

'"• Productive langua^ competc?ltpe; ' . 
A • rlexiCifity in jfche *appJLi cation of info^jnation ' :^ ^ 
' pr'oceasinn stratoqies ' ' , 

• »^ 5yhoo^ reac^jmesa . The init>La2L step' in selecting an instrument 
^to nc^ur'e "readiness was to'^def^rrfe 'th^fbehaviors or abilities - 

* ^wl^ich,:constAtute' "school rt^a'diftes's. " Anderson >and,MesSi|pk '(1974),* 
!"* preschool curriculum litera!t\ire, |nd', child development expert^^ 

vvere^ cdnsulte,d~ in arriving ^ thrttol lowing d^filiition: . , . - 

* \i SgHooI ^readines]5 typi^a-ll^^ encompasses, the cliild's . 

aqo.-appro'priate* acquisitioD of ft.he ^isual discrim-, ' ^ * • 
i ^ ' ^¥ ^ inatifon skills*; beqinning rtic6gn^tiQn«^f numbers and*. , 
- * letters? atnd^a basic understanding of j^Uantitative^^l ' 
' ^ concepts. , IrT addit^ion, . rjgad^n^ss implip.s the child . 
t * possesses a reasonabj.e'^degr.ee o^ knov^fedge" in ^reas 

^ , , . ' r important to. f uj^ctioningL inland oiit of schbpl^* This ^ , 

' * • niqht • include a basip -und^standing ofik. physical^ laws, - 
^ fule5? of. health 'artd safatiy, the ^'physical and social^ 

* ' eiYvirdririPnt f arj^^^racstic^l arts; . . * ^ 

r In a rfeyiejj^f 'other--4iead St&rt* evaluations and th-e battery 
.m: ' be VKi^cqnsi^re^for the National -Day* C^ar^ stydy several fu^e-^ 
^ ^hdOl-kin|[irrgarten. instruments were-fidenf i f ied Jivhiph ^l^puld be 

rv* . ^ ^fu46t^her Gor^^idere'd / Of thfese^Nthe Peabody^Pi^fture Vocabulary 
/ Test/ Pre^hool' InVen^tory^ and QenVef Developm^tal ^Screexvinf 
# * / . ^T3?gt receive d consideration for JpossaSle u»se , in ^Tsf te-speci'f ic ^ 
• batteries.' ^^though its use* i*^te'siricted small. **^^a;le 
^ "^ " iW'd a standardization s-^dy/ The CIRCUS ^Ander^o^/ et,'. 




ERIC 



68,' 8\j ■ 

' __J_ 



9 



/ 



al.; 1974 ),-^ith high ' rec6miftendat'ions from^OCD, also became a 
potent i'al candidate* When compared in .terms of ccntent, scope 
and ps,ychcn^tric • characteristics with the above prescl^ol measures, ^ 
the CiRCU-S is seen ajs .similar , .Jjut in som^ respects more '^ophis*- . 
ticated., Although the -fetandardizaticm saitiple -was heavily biased; -~ 
toward whit,e, ^ddle-s'ES*chi*ldren , th^ use of this instrnifn^^^ 
ij^ t'he PDC. e^4^1{ia,tiojj m^y generate valuable information concerning 
, its a^ro^ri'.aten^s for lo.wer-SES, blacJc chilciren. i Sinqe this ' ' 
) .information might al«o contribute to futute Head Start evaluations, 
certain CIRC|.>S 'subtests are recommended for use in 'site-specif iq. *' 
batteVie*^s. ,bri§f description of tl|^ instrument is provided 
, below and 'mo^^' detailed description of its psycKometric qualities ^ 
is provided' in the appendix. ^ ^ 

' • The. CIRCUS- is an , assessment • battery de^ltJped by Educational ^ ' ^ 
Testing Servj.ce . (Ajideraon , et al . , 1974} for preprimarV ch^J^dren.^ 
'The battery ii^cli^des ^6 diagrjostic measures designed to asse'ss ' . 
. jpecif j^cognitiye / language and perceptual motor characteris^^ics, . ^ 

. of prQscnool and kindergarten children. The authors used.^the theme"' . 
. .cff circus* to represent tji'eir 'basic pencil and paper testing 

format. J^^o^ ITiaft appeal to the ingpere^t-'of £he preprimary cjiild, >. f 
"thus assi-stin^ in maintaining his/hfer attentions' With the . 
e^^cejption-- of two subtests^ ail can be group-administered by a . ^ . 

teacher, or trained parapjpf assional . vCurrently,. a Spanish version, 
of the CIRCUS is under development by ETS. 

Although the authors dfcs(5ribe tho CIRCUS as a "comprehensi</G , 
• flexihlo proqran -of as^essnent services for ^preprimary children, " < 
r .tfestincr constraints and 'the PDC selection criteria^ led to selecting^ 
/ only thone subtests which af^sess school readiness Vather * than * ' , ' . 
» recommending* the Complete battery. This is possible, partly ^ ^ 
. because" the. authoi;s designed their • instrument to allow the separate 
use of»^ various subtests to^neasnro specific areas. kThe^iibtests 
^ , ^ reqommen'Shd foi: assessment !§phool readings are lisli^^and. ^ 

despril^ed }j^6Iow, *A fuller accoi^ixt. of t^eiri content and psycho-^ % 
metric features may ^e fouod in the appendix.,' > . ^ A - ^ 

• Hoy .r^uch ajff Ilou riyiy . This, su^tesj: was developed ^ 
\ . ^ to assess the child*s understanding of quantitative ' • ' --r, - 

condbpts. The child is first askeda4li^.seiect from . 
• . > ' amdng three choice's the picture v;hi<in'torrectly 



^dej^cts the* number of objects'- that a numeral repre- 
'sents/^ The second -compoijent ^^sks the child to* choose 
t^ji^^onger;;* smallest, -fi'rst: 6r bottom object in"order 
^ assess-^ his/her comprehensioJtV^f '^^amtitative 
^ ^ vocabulalrv. ' * • • / ^ 

^ . . . ' . ' . ^ 

• Fiading Let^ters a/i d ^umbers .< .This sulpV^st a(sks the 
child to selects ti^flP amorrg th*ree ghoices the 'letter 
or number riarped by . t^a^tester . 
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• Hov; \Jor^c^ IJorl: / This subtest focuses •oti thei structure 
' C-syntax or word^ordof) of- lannuaqo and the function 
wordn (prepositions, ♦ar^ticles, pronounsV con junctions ) 
which a santoncc nay c(?^ntain in ©rder to assess the 
child receptive vocabulai^y. The child is asked to 
* * ^ choose between tv/o pictures *the one .that tlic tester 
1^ has described ..in a sentence. ^ - * 

- ^ >i ' 

,* # ^ Do^ ItQu Knov7, , , ? Thir> sul^itest contains inf ornai-ion 

itens on Iioalth and safety, physical and social envi^n- ^ 
pient, consumer • beliavior, /or othWr factors relevant *to i 
the child ^s functioninq in and out of school. Thd 
tester requests the 'child to cfioqse from among three 
options that p^ctuire which best applies to a given 
, questiom or statement. For example, the t:hild may 

<^ 'be asked^ . "Which one of .these is S7VFE -to play with?" 

The child then c|^6Qses the appro^riate^respon^e^f rom 
pictures of a >>odk 'of - matches , ^knife and'a^spoon. 

While the 'administration ot these subtests in the^r complete form, 
might be tleBixa±)le 'for evaluation purpo'sesV-the toftal' -trirae - - 

involved (approximately 60 laAputes) would 'cause the total testing 
timeH:o become e^cessiv^ at sites where these objecti^s are to 
be assessed. Since PDC sites^ receiving thiS btittery' are ^ imple- 
mentiin<^ 1::urricula which ^phasi^e different aspects of school 
readiness, eaSk site may elect only one or two subtests. ^ 

Productive language competence . ' Language experts point out 
the dangers, of attempting to' assess "natural" latlguage in a 
standardized settino^' Nevertheless , the importance, of the attempt 
*ls not' denied. One^l^Rieli^^ use^ measure -(tJie IWA Verbal Expres- 
siion subtest — Kirk, McCarthy,* and Kirk, '1968; ParaskevopOuIo^ ^ 
l^ aiK^ .Krrk,>-i969) does not ^P'^^i^ to assess the type of productitxH' , 
described in^the goals ques xonnaire: ' "competence ip the narra- 
tiwve tise-o5 language demonstrated by creatively tilling a story ^ 
about a given event or experience." FurthenTtor:e,,,the^ ITPA has 
-received serious ^ritigjsm from a number of quarteip^" (e . 
Carroll ,^ 1972; '^ilrerson arjd Guest^ J970) . ^ ' , 9^ ^ • 

Competence in narrative lainig^age has been ^ssess^d in 'a 
,:pumber of FolJ.ow Through evaluations using procedures developed- 
by soBie or t,l>e^ Follow 'Through s^ponsors (e.g., Abrams, Rhodes, 
and Tanaka, i973r' GpulcT; .1974 ; :EoveT 1975) , but they have not 
.been adapted for preschool-aged children. ' - 

^ The Say and Teli cubtest of CIRCUS has a part that assesses 
. "natrative use of language'" *by asking the ciTiild to' make up, a 
story about a drawing of a busy^ircus^ r^ng. • The 'stOry is , 
recorded. verbatim 'and scored according to -the numbeX^of words, 
number of diffe'rent words, .use of^ labels,, • verbal, "modifiers / . % 
syntax, sequence, plot extension,^^organ^«tion, feeling, rhythm. 



and cadencev comparison, charactex* extension and spatial words 
i'here appears to be some^ question* as to the suitabJMity bf either; 
the story elicitat'io-n procedure, or th^ scoring - criteria since, 7- 
of the 12 .criteria were seldom seen in the preschool and kinder- 
garten stories •( fewer ' thafi 20% ^of the storiea^ontained. these 
elements)* Furthermore, there^ appeared to b.e little difference 
between preschool and kindergarten levels in the percent of 
stories containing the elements. This, was also true for three ^ 
summar'y measures: total wj)rds (mea.n of 41.7 for preschool, 43.1 
'for K) ; nuijUDer of different words (26,2 for preschool, 27.1 for 
K) ; and 'narratiop. quality (4.12 for preschool, 4.11 for K) . 
The gmall difference between children o.ne year apart suggests 
the measure may not be particularly senrsitj.ve to program effects. • 
Experience in using the same CIRCUS picture to elicit written 
^stories from older children^ in Follow Through suggests that the 
picture may' be too- "busy" and not appropriate for eliciting 
organized, secjuenc^* stories (Abrams, Rhodes, and Tanaka, 1973). 

Since productive language is an important goal format least 
one PDC ^'te (and^ it may be for sites that did not respond to 
the goals ques tiorinaire) and since several Follow Through sponsors 
have completed considerable developmental work of productive 
language measNares for the elementary grades, it. is recommended 

. that Say and Tell be listed as' an option for site-specific batteries 
; so that additiQnai psychometric data ca^ be obtaii^ed ^ur4.ng the 
pilot phase. In addition,, however,' it is recommeijcied' that an 
adaptation of €ha Follow Through procedur.es be developed^ for 
Head Start-age children and made available on an ' experimental b^sis\ 
this ^all tO' sites that ^are partijwjlarly concerned wi±h this goal. . 
By carefully considering 4:he s to Jfcelicitation technique (e.g., 
real' objects might b^ give,n to chrTT-dxen t-O play witrh before 

.•asking them to narrate\a story), and scoring criteria cippropriate 
for Head Startvage children,' .it should- be- possible to haVe^ a i 
testing procedure^ ayailable by fall which Vill addrefis this * , 
Ifeite-specif ic concern- * ' - * / • . ^ 

flexibility in- the ^application' of information processing 
strategies / Anderson and Mdfs^ick defined this flexibility as „ . 
follows: "The chiJLd recognizes that Lhere are di;fferent approaches 
to 'exploring th,e ^rivironment and to oblfa'ining ' and processing 
information from it, he recognizes that "th^se approaches are 
differentially effeptive in different sitUat ibniS , ^and he applies 
these approaches^ flexibly, and appropriately .without being ^ 
locked into habitual/ modes of perceiving and thinking" (Anderson 
.and' fossick,, 1974 , p»^291). ; , ' ^ 

' .*7 " • ' 

' The Rand report discus s-ed 5javefa^l constructs related tt) 
this competency by considering flexibi lity 'in. re^pori^^^ to botM 
▼nonpersonaii|^ana* interpexsonaL^stimuli. Seyetai measured wejre 

recommends© by Rand; but most of them were dfevelopeJ as exj^ri- 
. mental technic^-Bs to measure .components of "flexibility!" A 
c^isadvantage* sheared by all the measures.! is the a^rtif iciality ♦ 
of the structured testing situation. In the Concept-Switching' 
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•IVisk of ^^Zigler and cl^^Labry'' ( 1962 )V fo^ 'example , the child i? ^ 
askod to sort and resl^^rt a -set of - concept ^c^ards . In^addftion 
to roprcsontin'^g only a , narrow ^aspec^ of 'flexibility , there is ^ 
si:)mcv-quostion -as to whether the, d^ceritering, required^ by such- a', » / 
task makes it suitable' for\preopbratLonal children.- In, another^, 
<u*ca, presenting children with 'situations where multiple solutions 
are possible (e.g., the "unusual uses" tyj3e of test), Rand' 'f 9\iD:d 
no measures to recomme^nd. - ^ ' * 

' If— Hre'xibiJ/ity of^ response to intejrperfeo-nal stimuli is^con-^ 
sxdered, the PIPS' test, which is recomin^rided "as a measure of 
social prol:>lem-solyincj , mafy very well be relevant to the 
"flexibility" goals' of some programs} The classroom observation 
system ^Iso includes behavior categories* that . address a.spe?:^t^ ' 
of flexibility: Category 6 ("uses pe^t as resource" ) 'cdd^s 
. whethej: the child asks for help before or after attempting to 
solve a problem. ^ . ,\ ^ 

" Although these few measures ipay not satisfy the needs of ^ 
, programs with a strong interest- in arssesS^ing ' this competency, ^ 
given the measurement probleifts in this area-and the constrain^ts 
on- test development efforts , it is recoirrniended/ that no additional^- 
measures be selected for the. asses'sment of "f/exib^ity in the 
application of inf orrfiation processing strategies-" 

, ^ Au ditory ciiscrilTiiWiiliion , "As ^mentionedr in the section , on 
psychomotor measures, no auditory descrimination or Visual per- 
ception measure. 1^ 'recommendei^ 'for" the bas^^ppattery^ ; • Thus , to 
accommodate sites that mighH; be interested jK thia p'krticular. , / ^' 
psychomo^tor arfea,' the Wepiyian ^ Auditory Discrimination -f^sk will- 
be availafc)le as a sitg-^pec^if ic optiqn. 

, * ' K ' ' ' / ^ 

Procedures for Implementing gite-Specifxc Batteries * 

' ' Since sit(^'pecif ic measures are, by ctefinition*, necessary 
only if sites .rfiS^Lre 'to be' ^ssessed with those measui;es,-a pro- . 
°cedure has been 3g\e^^ed for obtaining input from sites regarding 
the proposed measTDrelT^, A "d^scr of each instrument and an 

outline of proc^lHres will Be prepared July 15 ^ These, will be ■ 
sUt to all PDG^'r^^ram^ with a let-ter ^esctibing the pUrpose of 
tiuj site-specri/f ill batteries, and a request for 'a respon-se by 
JVugust 1 if thi&.-^te wishes one or moj;e-of these measures -to 'be- • 
mpludeci in their battery. This amount qf' lead, time is needed ^ 
to prepare th^ ne^cessary test booklets and materials and to ma.ke* 
arrangements for tester traioing.* Sites :will h^ave to be somewhat 
limi.ted in' the , number: of measures they can*a3/r'±o be evaluated 
with, ^.nce there are limitations, in the total t)Lme avai^ab^le' * 
for testing. ' . ' ' * * ' * 
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SUMMAR^OF RECOMMENDED MEASURES *. 



'Soc i a Ir^ Emotional^ Measures 



- ' ^^■'-^ Interview* / ♦ ■ t 

Pr^chooJ Interpersonal P1:oblem-S?)lving Tes^ ^ ^ 
*Stephens-Del^s Reinforcement Contingency. Interview 
Pupil Observation Checklist . • * 
Child Rating S^le*„ , ' • /' 

^DC Classrooiji OTseryatipn System* - 

PsychonApr Development, Health and 'N^itr^tion Measures 

Block' Building (MSCA), . - 
Draw--A-Chil(^«.(MSCA') ' ^ . ^ 
Conceptual Grouping ^(MSCA) ^ • ' 

. ^ Leg Coordiiliition (MSGA) ' ' - ^ V • • 

^rm Coordination. (MSCA) .v * • * . ^ • 
Block Design (WISC) - - - ^ 

Block" Desiqn CWPPSI)^ ' • 

Health and Nutrition Rec<5r^s » 



Cognibiye' and Language Measures 

^' . Block Design (WISC) • ^ ^ • 
Bloc)^ Design (WPPSl)/r 
Conceptual Grouping (MSCA) 
^- Verbal Memory, (MSCA) 
'.Vei^bal Rluency (MSCA) 
' Opposite Analogies (MSCA)" 



Teacher and Parent Measures 



1. ' 



^Teacher Sur,vey* 
Parent Survey* ' - ■ . 

Biiingual/tei6ultural^' Measures 

' ' ' ' . ; ; " 

. 5iliij^uals* Syntax Measure* 
PDC cl'as^flTOom jObserv^tiO|j^ Systeln*^ 

Measures £oVv?i^~^scif ir Batteries 

' ^7^ — ' \ — » 

How Much and How ^Iany • ^CIRCUS) * ' 
Finding Letters. and Numbers (CIRCUS) 
How Wo rd^- Work XCIRCJLJS),' / ' 

. Do You Know (CIRClls) % , ' 

/ Say and ,Tq11 (CIRCUS) ' 

Wepmarj Auddt6ry ' Discrimination Te^t^- 
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*To be developed. ^ 
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Pteschool Interpersonal Problem-Solving Test 



PUBLISHER OR AUTHOR: 
APDRgSS: 

CONTENT: Socf al-emotianal 



Shure and Spivak 

Hahnemann Medical College and Hospital 



social problem-solving 



DESCRIPTION: 



Tke PIPS attempts- to assess the child's ability to name 
alternative solutions to two life-related types of 
problems: (a) ways for one child to obtain a -toy from 
another and (b) ways to avert the mother's, anger which 
could result frojpfi damage to property. Among innisr city., 
four year olds a-ttending^ the Philadelphia Get Set day 
care program those judged as better adjusted .by their 
teachers were able^ to g#nc6ptualize a greater number and a 
wider range of alternative solutions to real life, problems 
than could their more poorly adjusted classmates^ 
irrespective of sex types. PIPS scores have 'also related 
to the child's general .concern for the feelings. of 

-others (empathy) , the degyree to which he was liked by 
his/her peers, and to a lesser exte^at, the- degree of 

. general initiative and autonomy shown in the classroom. 



AGE RANGE: 



4 to 5 year olds 



ADMINISTRATION: 



Test fiftie: 20-25 minutes , * * 

Group or individual: Individual ' ♦ 
Who administers: , Trained tester 
How administered v Interview 

Response mo'de : Verbal • ^ ; ^ 

Comments: Multiethnic pictures are included to facili- 
«^ . — 

tate responses 

VALIDITY: Validity for the PIPS is claimed by the authors- because 

^ significant correlations were observe.d with- teacher ratings' 

of social adjustment. It a{>pears that the test can dis- 
criminate between children who differ in the degree of 
behavioral ad;justment exhibited in i;he classroom. There is 
a low-^ but significant correlation between, the Peabody , 
\ picture' vocabulary test (PPVT) and PIPS scores (r = 38^ * ' 
p<.01). , No correlation- wa§ observed between degree of Ver- 
balization ' and^ PIPS . . ' . • 

RELIABILITY: Irfter-rater reliability = .86-. 89 ' 



Test-retast : 



180 Children were retested after a period 
of 3.5 monthfe. Reliaisdlity coefficient - 
•.69 according to^the- authors , ifehis evidence^ 
.indicates that PIPS test measures a property 
of thought that remains relatively' stetble ^ - 
for long pei^ods^ of time . * n 



NORMS: • Over a four-year period, a total of 469 \nner city four-. 

year olds (220 boys and 249 girls) have been ^administered 
. * ' the PIPS between the months of November, and." January . -Based 
on cumulative percentages it was possible to deteinnine cut- 
off scores for^ differentiating between behavior categories 
of adjusted, impul«sive and inhibited. 



SOURCE IN WHICH DESCRIBED: 



Shure arid'Spivak. Problem-solving think- 
j.ng and adjustment among disadvantaged*. - 
Child Developments '-'1971, £2, 179-180, 
Social Adjustment of Young Children ^ 
Spivak and Shure ^' 1974 . ^ . ^ 



PERMISSION .TO USE CAN BE OBTAINED FROM: 



Dr. Myrna Shure-, Hahnemann 
Medical College and Hospital, 
Pittsburgh , Pennsylvania 
19102. 
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Stephens-Delys Reinforcement Contingency Intervirew 



PUBLISHER OR AUTHOR: 
ADDRESS: 



Mark W. Stephens 
Apt. ^647 

1127 Lincoln Ave. 
Evansville , Illinois 



47114 



CONTENT: 



Social-emotional : locus of control 



DESCItlPTIONi 



X his 



Thisr measure taps a child's expectancy that his own 
behavioi^«*ould change/ the probability that reinforcement 
might^^bur; that is, if he chaiiiges his behavior, will 
.\ ^ , his ^eachers parents ' .or friends' attitude or 

behar^ior change as a (result. Forty questions have 
been used (but a shortened form of 20 questions ^s 
possible) posing reinforcing-type events, e.g., "What 
makes mothers smile?" " Responses are coded "internal" 
if answered,* "When I..." and ^external" when answered, 
. • ' . • "WheVi Daddy (or someone other than self)...". This 

test haa 'been used with Head Start children as well as 
575 second grader^* from Follow Through classes and 
mididle-class schools. iSubscales are possible for 
teachers, parents, and peers. ' * ^ ' V / 

AGE RANGE: 4 years through 10 years 

( m 

ADMINISTRATION: Test time: 10 to 25 minutes 

' Group -or Individual: Individual 
Who ^administers: ^Trai'ned testeir 
How' admin is tiered: Interview 
Response mod^': Verbal, f ree-responrse 

, VALIDITY: Discriminants This test was related consistently with I.Q. • 

teats of preschoolers . 
Convergent: The Evidence is- inconsistent. Locus of control 
appeiars to be a. multi-dimeiisional constr^ict for 
chiMren as well as adults. 

RELIABILITY: * Subscal^s intercorr.el^te .70. . 
Inter- rater reliability was .98. 
Test-retest reliability a£ter 4 months was'. 62. 

NORMS: ♦I Ss fr6m Head Start . classes were found to be significantly 
less internal than 4 5 middle-class children. Internality 
increases with age.i 

Disadvantaged Ss = ^6.* Advantaged S^ = 14.2. ^ . r 
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t 



SOURCE IN WHTCH DESCRIBED: Robigson^J. P., and Shaver, P. R. Measures ^ 

of social psychological ^ttitudes> Univer- 
sity of Michigan Institrute tor Social • 
Research, Ann Arbor, 1374. 



PERMISSION TO USE CAN BE ^OBTAINED 



F^OM: 



Mark Stephens 
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Pupil bbservatign Checklist (POCL) 



PUBLISHER OR ^AUTHOR: 
ADDRESS: • 



High/Scope Educational Research*Poundation 
600 N. River gtreet # 
Ypsilanti, MI 48197 



CONTENT: Social- emotional : Test-taking- behavior 



DESCRIPTION; 



This is a. rat 
developed* fo 
scale used i 



I 



AGE RANGE*. 



g sc'ale o'f nine 7-point bipolar adjectives 
ther*Home Start evaluation from a 25-item 
Follow Through, Two factors (labeled 
"Test Orientation" and ^Sociability") w^re found con- 
sistently across, several time points in ^ the Home Start 
^ eval^aation. * . ' * 

Used for 3 to 6 year ol'<5 children; probably suitable' 
for older children as well. ' « - 



ADMINISTRATION; 



Tiest time: 5 minutes of tester's time per child 
Group or' individual : Child is not involved 
Who administers: No training necessary 
How administe¥6d : Rating scale 
Response mode: NA ^ ' ' - 



VALIDITY: No information 



-RJSLIABILITY; ^ Internal consistency alpha above .90 for eagh scale; 

> Testf-retest correlation (7 month interval) found to 
depend on treatment group: Test orientation; above 
.60 for Home Start, .48 for control, and .49 for Head 
Start. sociability , above .50 for H6me Start and"*^ 
control group, ,36 for the Head Start: sample. 

NORMS: Scale scores available for samples of Hom^ Start, control 

' and' Head Start children at various time points, e..g., pretest 

scores available 6n a total of\552 children from age 3 to 
5 1/2 at 6-month intervals * " • ^ ^ . . - . 

SOURCE IN WHICH DESCRIBED:"' Deloria, D.,/^'t al., The National Home 

Start Evaluation; Interim Report IVs 
Summative Evaj.uation Results ^ Report to 
- . - \ OCD, HEW, 'June 14, 1974. 



PERMISSION TO U^E CAN BE OBTAINED FROM; 



Regearch Department, 
High/Scope Foundation 
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Mc Carth y Scales of Children's Abilities 



inJB-LlSHER OR AUTHOR: 
AQDRESS:^ 



Dorothea McCarthy 
Psychol ogic*al Corporation 
304 fiast 45th^ Street 
New York, New York ' 1001.7 



CONTENT^ Cognitive, Psychomotor ^ 

DESCRIPTIONS:^ Series of ta's^s' tapping ■ problem-solving , psychomotor, 

and conceptual ^ Abilities similar^ to th^ Wechsler scales, 
hut- with emphasis 'on -.age-related maturational indicators. 
• $ ' Tests of general abilities,, some of which may be sub-' 

^ ject to program eff^ts. ^ ' 

AGU RANGE: '2-1/2 years through 8-1/2 years 

ADMINlSTI^TION-:\'Test tilrie: 40 minutes total 

Group or individual:" Individual ~ • ^ 
Who administers: Trained tester - 
* How administered: Testing 

.Response mode: Variable, depending 6n' task — verbal 
^ and motor ,perf orman'ce 

Comments: ^ Relatively few black-white differences 
, , * 6n scales encourages use with disadvan- 

. taged 

Test is too new-- for majq'r validation studies. Manual 

presents high pbsiiive correlation (\70^.85) of total 

scor^ with WPPSI, StanfDrd-Binet , and moderate correlations 

with first grade achievement tests (.30-. 49). 
f ' f • ^ ■ * 

Intercorrelation of subtests 'and stability coefficients* 
for , individual subtests are nc^ presented in the manual. 
Rentfrow, et. al^ (1972) present re-test Qorrelaticjois' . 
^ and subtest-total correlation^ which are high and posi^ . 
tive for most s^ubtests chosen. * \ 

NOIIMS: .Standardized* on 1 ,032 children, selected a^B representative of 
U.S. population^ (geography , urban-rural, ethnic background, 
father's occupation) / * * ' K 

SOURCE IN Wtf^rcn DESCRIBED: . McCarthy Scales of Children ' s Abilities 

' Manual (McCarthy, Dorothea, 1970) • 

PERMISSION TO USE CAN BE OBTAINED FROM'; Psychological ' Corporation 



VALIDITY ; 



RELIABILITY; 
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. ' * . ■ • c 

. Wechsler Intelligence Scale for Children j Block Design (su^tesKt.)' 

PUBLISHER OR AUTHOR: DAvid We^schler 

ADDRESS: ^ . , Psychological' Corporation 

304 East 45th Street * , • 

j New York, New York 10017 ' . ' 

CONTENT: Cognitive, Psychomotor V 

. ' . ; 

DESCRIPTION: Task consist^' of -child ' s reproducing (constructing) 

N 'designs with colored bl^s^cks (cubes) either modeled by /. 

the examiner or presenteo^on a card. The measure taps 
problem-solving abilities, flexibility in response style, 
visual-motor organization and execution . ^ ' / 

AGE RANGE:- 5 years through 15 years / 

\ / 

ADMINISTRATION.- Test time: 10 minutes (timed items) ^ • 

Group or individual: Individual , ^ / • 

, Who administers: Trained tester / i * 



How administered: Testing "^ - ^ / 

/ 



Response mode: Manual performance/^ manipulati oh of 

objects ^ ' , ' ^ 



VALIDITY: Studies were not reported for this subtest alone . /concurrent^ 
* * validity of overall wise scores: ^ coirrelates highly with 

Stanford-Binet (r=.80's) in many, stitjfiies. Studies of pre- 
^d^ctive validity have not been fep^fted.\ . / ^ 

RELIABILITY: Split half reliabilities * at threat age leveJ.s were pre- ^ 
\^ , ' • sented in the manual, all—in the .^5 rang<B. Block- 

Design correlates in the .50-. 65 range wi.th the Full . 
/ ^ Scale I.Q. score at various ages. 

NORMS: Standardized on. a representative selection Ot U.S. White child- 
ren Cbased on geo^r'^phy, urban-rural, aJid ^^ccupatidnl . Ther*e 
were 2/200 children in the sample. / ... 

SOURCE IN WHICH DESCRIBED: Wechsler Int;elligence Scale for Children 

Manual (Wechsler D, , 1949) \ ^ ^' * 

^.PERMISSION TO USE C^ BE QBTATNED FROM: Psycho]|tical ' Corporation 



/ 

/ 
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Wechsler, Preschool and Primary Scale of Intelligence^ Block 
pesign (subtest) * ' ^' '- ~ 

PUBLISHER OR AUTHOR: Psychological Corporatioa 



ADDRESS 



304 East 45th Street 



New York, New *York 10017 
CONTENT: Cogni-tive , Psychomotor 



DESCRIPTION 



AGE RANGE 



Task corisists of child's reprodticing (constructing) 
design^^withr flat colored blocks either from examiner's 
model /Or picture on a card. The measure taps problem- 
solving abilities, flexibility of response s.tyle, v^ual- 
motor organization and execution. ^ 

4 years through '6-1/2 years , 



ADMINISTRATION: Test time: 10 minutes (timed items) ' J 

Group or. individual: Individual , ~ , ^ 

Who admini&ters: Trained tester^ 
How administered: Testing ^ ^ 

* Response mode: Mani^al performance, manirpulation of 

ob3ects ' ' » 

VALIDITY: Studies have not fully examineci^ the validity of this subtest 
'Predictive: Studies with adequate sample siz^s haven't 
been reported, 

CQndurrent: .Correlations with the St'anf ord-Binet and the 
Full Scale "I. Q.' are reported in the .70-. 80 
range . ' , " . ' 



RELIABILITY: Test-rete^t reliabilities for Block Design ,for age 5 1/2 
V . children is reported in the manual (r=.77). ' Eflock 

correlates with Full Scale I.Q. at .50-:. 6 5 at various 
^ ages. ^ ; . » ^ 

NORMS: Norms vere reported for representative selectipn~of 1,200 - 
U.S* children stratified by geographic region, ethnic back-. ^ 
ground, and father's occupation. 

SOURCE IN- WHICH DESCRIBED: Wechsler Preschool^and Prima^ry Scale of 
,^ Intelligence Manual ^Wechsler, D. 1367) 

PEI^ISSION TO USE CAN BE OBTAINgD FROM: Psychological Corporation' 
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Bilingual Syntax Measure 



PUBLISHER OR AUTHOR: 
ADDRESS : 



CONTENT : Language 



Marina Burt, Heidi Dulay and Eduardo Hprnand«z 
Harcour^, Brace , Jovanovich, Inc% 
New YorK, New York ^ 



DESCRIPTION : 



This tesjt is 'designed • to meaixy^e children's oral pro- 
ficiency in English and/or Spanish granunabical »struGtures 
by using natural speech as a basis for making judgments. 
Simple questions are used with cartoon- type colored* 
pictures^ to ^provide the framework for a conversation with 
the child'. An analysis of the child's speech yields a 
numerical , indicator' and a qualitative description of 
thie child's structural language proficiency. Responses 
are written down verbatim. • ' - • 



AGE RANGE: 



ADMINISTRATION: 



4 years 
f 



tVi rough 9 years 



1 



Test> time: ' 1<J-15 mi^jutes • 
Group ozi individual: Individual 

Who administers: No training necessary (must be 

bilingual) 
How administered: I^iterview ^ *. 

Response-^ode : Oral * ' \ ' 

Comnjents: This* tesrt c?an be used as a test *of language' 
dominance as well as a test of'' the degree 
. ^ of maintenance or loss of ceijpain basic 
. ' Spanish' gramn^atical structures in dhildr^n 

Who Required /Spanish. ' . ^ 

VALIDITY: High face validity. The Rationale and Technical^ Report 
w^s not available at the time of thi« wri^ng. ' " 

NORMS: Norms on 2,300 English-speaking children and , 2 ,000 , Spanish- 
speaking children tested in Ma-rch, 1974 are available from • 
the publishers. '. ' » - , " 

■ ' - ■• , 

PERMISSION TO USE CAN BE OBTAINED FROM: Harcourt, Brace, Jovanovich 
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CIRCUS^ Subtest: Row Much and How Many 



PUBLISHER OR ^AUTHOR: 
ADDRESS: . . 



Educational^ Testing Service 
Princeton/. Nev Jersey 



CONTENT: Cognitive - ^ . ' . ' , 

DESCRIPTION:. Child is presented with sets oj^ pictures and- must choose « 
, \,"the picture in each s^t which illustrates the approprif^te 
" ^ , ' fiumerical or relational- concept. Authors claim .the .test 

measures these concepts and child' s' comprehei^i on of^the- 
vocabula-ry used in the items* \ \ ^ 



AGE RANGE): 
ADMJN I STATION; 



Preschool and kindergarten 



r 



VALIDITY: 



Test time: 20 minutes - . , . • 

Group or individual: Group * • . , 

Who administers^: Teacher 

How ^adSninistered: Testing - . _ 

Response mode:^ Pencil and paper ^ 

Comments: Quantative concepts measure is confounded 
with* vocabulary comprehension. 

No studies reported. Validity claimed by aut^iors^ on the 
importance of the variables measured (face validity) . 



RELIABILITY: Reported split-half: r=.88, .87 - 
Reported Alpha: r=.87, .88 



NORMS: 'standard:j.zation on 567 kindergarten children and 582 ^nursery • 
school .children from fouj;- geographic areas' of the U.S; Since 
actual sample was based on return^ from selected classes, 
•sample is biased by those tests \^ich wqre returned (i.e.. 
White, middle.-class) , > ' 

SOURCE IN WHICH DESCRIBED; CtRCUS Manual and Tecljaical Report 
^ (Anderson, et%l.,'1974) _ ^ 

PERMISSION TO USE CAN BE OBTAINED FROM: Educational Testing ^rvice 



96 ' 

107 



J 



CIRCUS , "^subtest: Finding Letters and Numbers ^ 

P'OBLISMER OR AUTHOR: ^ Educational, Testing >Service 
ADDRESS: ^ . Princeton, New Jersey . > 

' C0NTEN3?-: Cognitive « . . 

DfiSCRIPTlON: Child is pi^esented witli sets of pictures of \ettes:s or 
, , numbers and chooses the^appropriate re spprisGAVe present^ 

, ^ ing the letter or number the te^acher has" najittck This 
test is, designed to measure recognition of l^tt^ris and 

• numbers and a& such is ^a readiness test. 

'AdE RANGE: Preschool anc^ kindergarten ' ' ^ ^ 

ADMII^I^TRATION: Test time: 20 iwinutes 
, . ' Group oc individual:. Group 

* Who Administers : TeScher 
•How 'administered: Testing ' A\ 

* * Response mode:' Child^ poi^its or names correct' item ^ 

• * * ^ ^ Comments: Possibly useful as' a diagnostic teiit, 

although sequencing, *an important ic:orre- 
* ' ' late of recognition^- of letters dnd numbers, 

' ^ ^ , . . i^v^not^ tested. 

VALIDITY: Not available (see ,previous page) • 

^ RELIABILITY: Reported Split-ha'lf: r=.86^ . ' - - 

NORMS:. Standardization on^ 290 kinderrgarten children*and 546 nursery - 
school children from, four geographic areas of th^ U.S.- Since 
" actual sample was based on returns from selected classes 
sample is biased* bj^ those tests which were 'returned (i.e., 
' ' , . White, middle-class). ' . 

• ' * //^ * 

* SOURCE IN WHICH DESCRIBED: CIRCUS ^ Manual and TecKnical Rep6rt * 

' . ^ (Anderson, et al . , 1974) ' . * . 

PERMISSION JEQ US|; CAN BJl OBTAINED FROM: Educ^tion^?: Testing Service 
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. ■ ^ ' ...» . . ' .N. ■ \ , . 

CIRCUS , subtest: How. Words Work ' , . - 

• / • ■• ... ■ - .'. ■ ■■' 

< PUBLISHER. OH AUTHOR: E4uc^tional Tesbirig Service 

•ADDRESS: . - ' , . - • .'Ptrincetotr, New Jersey' .. • . ' • 

CONTEl^T: Cogrfitive - ' ^ ' 

' ^ ^ • • * - ^ . ^ ^ • V - : ' 

bESCR^PTlON: . Child listen^ -to teacher reading a sentence and-then 
. -5:^ - chooses 'the appropriate picture which, illustrates the 

, fUfnctiona^l word^s in that sentence-. 'Functional ^ords 

include prepositions,* conjunctions, ^ and prortouns. 
A^uthors describe ^this task^ as tapping ^ nuinBer of 
' ' aspects of./ functional Tanguage. 

^\'AGE RANGE: Preschool- and ki^ndergart'en . / < ' ' ^ . 

ADM'INIS'TRATIQN:' Test time: '2Q ininutes ' ' ' - ' ^ 

Group or iijdividual: Group 

Who adnvLnisters : Teacher / ' : , 

. ^ - How administered t Testing ' ' . '* ' 

Response mode: Pencil and paper . ' - , 

'Cofiunenjbs: ' Mul'^iple concepts in each item and neces- 
X * * sity for vocabular j comprehension mSke 
'actual scores impossible ^to interpret,*^ 

VAUDITY: 'Not available . ' - - — , • 

RELIABILITY: Reported split-half:" r^.'^Sl - ' ^ ' ^ 

^ Repprted Aipha (internal .consistency) :• r=,^8 * * ; ' 

. NORMS:. 'Standardization* on 252' kindergarten children and 594 /nursery . 

school children from f<jur qefpgx^phic areas of the U.S. Since ^ 
(^^ actual sample was based oniretums from seleofced classes^, . 

, ' ' s^ample- is biased by those tests which weffe pftUrned (i^.e., c 
White, n\i*ddle-class) ^ ^ ' . ' ' 

SOURCE- IN, WHICH DESCRIBED: CIRCUS ManiaAl etnd Technicar R6port ' ^ \ 
. ' . ^ (Anderson, et al.,, 1974) 

, /permission T(/^ JSE CAN..BE OBTAINED FROM: ' Educatiojia'l . Testing Seryifce 



CIRCUS, subtest! Do You Know.,,? , ' V 

. ' " -\ ' * , i 

PUBLPSHEH OR Ain'HOR.: ' Educ^tionaL Testing Service 
ADDR^;SS:\ '' ' . Pririd^toxi, New Jetfeey * ^ 



COiaTENT: ' Cognitive 



• DESCRIPTION; This is a general information test. Child chbo^ses 
» . ^ appropriate picture which answers' teapher' s question. 

: \ ' This task taps^ the child's experience in a vari^y 

areas ' (health, safety, Social stan^arc^s, consumer coh- 
' ' cepts) . * ' . • ^ ^. ' 

AGE RANGE:' Prescrhool and kindergarten * - 

. ADMINISaaATION: Test time: 20 minutes 

Group or individual: - Group/- 

Who ' fiidrainistefs : Teacher ; ^ 
How administered: 'Testing ^ - 

; ' • J^esponse mode: Paper* and pencil ' ^ 

^Comments: Obvious ceiling oh a majority of items 

for the standardization sample. Np examin- 
ation of possible cultural bias 'in questions 
* ' ' ^ ^ .and pictures. - . * 

VALIDITY: Not available 

-RELIABILITY;, Reported sj>lit-half: rT=.78 ' 

Reportec^ Alpha (lateral consistency): r=.79 

NORMS; ' Standardization on 286 kindergarten tihildren and 591 nursery^ 
school 'children from four geographic areas of the U.S. , Since ' 
actual sample was based on returns ^from selected classes, 
sample is biased by those tests which were returned (4<^ • ' 
White, middle-class > . ' /' ^ . ^ ^ . - 

; ' ' 

SOURCE IN WHICH DESCRIBED: CIRCUS Manxial and Technical Report 
' , ^(Anderson, et al.., '1974) 

PERMISSION TO USE CAN BE OBTAINED FROM: Educational 'Testing Service 

/ • • • 
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CIRCUS, subtest: ' Say and Tell 



PUBLISHER OR. AUTHOR: 
ADDRESS:. 

CONTENT: Cognitive 



E^Jucatiorfal Testing Service 
Princeton, New Jersey 



DESCRIPTION: 



Part I^ of this test consists of two parts and taps 
chilUreiY^s descriptive language abilities. In the ^ 
first part the child 'is gi*ve^ a ^pencil and asked 
attrih?ute questions, e,g.|, "What color is it?";* 
in the sej?t5nd patt the child^is given two pennies 
and is at^ed to describe them. Sco^^ing is^ based on 
categories of attribute which the- mentions . ^ 



AGE RANG*:: . Preschool and kindergarten 



ADMINISTRATION: 



Test time: -5 minutes 

Group or .individual: Individual 

Who administers : Teacher 

How administered: Tes'ting 

Response mode: Oral ^ , , y 

Comments: Reported test scores on the norming 

- sample of nursery school and kindergarten 

chil<3r^rv fail to show improved ^performance. 

with age. 



VALIDITY: ^Not available 



RELIABILITY: 



Reported split-half: Not available ^ 
Reported Alpha (internal consistency) : 




NORMS: sk:andardi2ation on 541 kindergarten and 227 nursery sChoQl^ - . 

children from four geographic areas of the U.S. Since - ^ 
actual sample was b^sed on returns from selected- classes , 
sample is biased by -those tests which were returned (i.e.^ 
* ^ White, middle-class) . 

.SOURCE IN WHICH DESCRIBED: CTRCUS^anual and Technical Report 

^ (Anderson, et al. , 1974) 

PERMISSION TO. USE CAN BE QBTAINEp FROM: Educational Testing -Service' 
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'' Auditory Discrimination *Tegt. (APT) " 

PUBLISHER OR AUTHOR: Language ^^Resd^rch Assogiation ' 
ADDRESS:' y ^- 950 East 59th ^tree.t, Box 9§ ^ . , 

Chicago, ,rL 60^37 . . ' 

CONTENT: Psychofnotor ' / ' ' ^ 

. DESCRIPTIOIJJ: Pairs of words, some ' the .s- a^. some different,' are 
.read to 'the. child who is ^asTci^^ to respond "same" or 
^ ^ "different" to' each pair. • '♦Ajjseparate score is obtained 

for errors on both types of pair-s. 

^GE RANGf/:' 5 to 8 yfears \ - / . 

ADMINISTRATION:' T^st time: 5 minutes.', ^ ' ' 
' - 'Group or individual': ' Individual 
Who administers: Teacher 

How administered: Testing/ • 
Response mode: Oral * - . 

VALIDITY: • Validity is determipe^ by, performance on 'same word pairs; 



auditory discriminatitin is ,de,termined' by perf Okonance^ on 
' different word pairs. Correlation with intelfligenCe* 
tests is reported as r = ^32. ^ 



RELIABILITY: Test-retest reli^bilj.^y on 109 subjects: r = ;91., 

NORMS: The- test has been normed on 523 children aged S^years and 
old^x from both urban and non- urban backgrounds. 

SOUT^CE IN WHICH DESCRIBED: Byros Sixth Mental Measurements Yearbook 

PERMISSION TO USE CAN BE OBTAINED Tr6M:' Language Research. Association 

• 950 East 5^th atreet^ Box 95" 
, Chicctgo, IL €0637 - \ 



